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(57) On an information recording medium, an entire 
stream including a plurality of portion streams, each of 
which is provided with picture information or audio infor- 
mation constituting a series of content, is multiplexed- 
and-recorded by a unit of packet. The information re- 
cording medium is provided with a file for storing object 
data, which is constructed by a plurality of packets, each 
of which stores therein a piece of the picture information 
or the audio information. The information recording me- 
dium is further provided with a file for storing information 
which defines a reproduction sequence of the object da- 
ta and a file forstoring information which defines a group 
having a specific relation from among a plurality of the 
plurality of portion streams. 
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Description 

Technical Field 

[0001 ] The present invention relates to an information 
recording medium, such as a high-density optical disc, 
on which various information can be recorded at high 
density, such as main picture information, audio infor- 
mation, sub picture information, and reproduction con- 
trol information, an apparatus for and a method of re- 
cording the information onto the information recording 
medium, an apparatus for and a method of reproducing 
the information from the information recording medium, 
an apparatus and a method capable of both recording 
and reproducing the information, a computer program 
for controlling the record or the reproduction, and a data 
structure including a control signal for controlling the re- 
production. 

Background Art 

[0002] DVDs are generalized as optical discs on 
which various information is recorded, such as the video 
information, the audio information, the sub picture infor- 
mation, and the reproduction control information. Ac- 
cording to the DVD standard, the video information (e. 
g. video data), the audio information (e.g. audio data), 
and the sub picture information (e.g. sub picture data) 
are individually packetized with the reproduction control 
information (e.g. navigation data) and are multiplexed 
and recorded on a disc in the "program stream" format 
of the MPEG 2 (Moving Picture Experts Group phase 2) 
standard, which is a highly efficient encoding technique. 
In the video information among them, there is only one 
stream of data compressed according to the MPEG vid- 
eo format (ISO 1 381 8-2) within one program stream. On 
the other hand, the audio information is recorded in a 
plurality of methods (namely, linear PCM, AC-3, MPEG 
audio, and the like). The audio information can exist up 
to 8 streams within one program stream. The sub picture 
information is defined with a bit map and is compressed 
and recorded in a run-length method. The sub picture 
information can exist up to 32 streams within one pro- 
gram stream. In the case of the DVD, as described 
above, a plurality of streams of the chooseable or se- 
lectable audio information (e.g. streams of a stereo 
sound, a surrounding sound, an original English sound, 
a dubbed Japanese sound, and the like) and a plurality 
of streams of the chooseable or selectable sub picture 
information (e.g. streams of Japanese subtitle, English 
subtitle, and the like) are multiplexed and recorded by 
using the program stream format, for one stream of the 
video information in one movie or film, for example. 
[0003] On the other hand, the "transport stream" for- 
mat of the MPEG 2 standard has been recently stand- 
ardized, and this is appropriate for higher capacity or 
higher speed data transmission. According to this trans- 
port stream format, a plurality of "elementary streams" 



are transmitted at the same time at a much highertrans- 
mission rate than that of the above described program 
stream format. For example, a plurality of shows or pro- 
grams, such as many TV channels of satellite digital 

s broadcasting, are time-division-multiplexed to one sat- 
ellite wave and are transmitted at the same time. Name- 
ly, in the transport stream format, it is possible to time- 
division-multiplex the elementary streams of a plurality 
of videos, each of which has a large data amount, and 

10 transmit them at the same time. For example, it is pos- 
sible to transmit at the same time a plurality of movies 
recorded on a plurality of DVDs. 

[0004] Moreover, if employing the transport stream 
format described above, "multiple broadcasting" or 

is "multi-view broadcasting" is also possible, which can 
perform in real time an angle change similar to the angle 
reproduction function (i.e. a function of automatically re- 
producing a picture of an angle by preparing a plurality 
of camera angles for one story and specifying the angle 

20 which a user would like to see), which has been already 
realized in the DVD standard, for example. More specif- 
ically, according to the "multiple broadcasting", transmit- 
ting at the same time a plurality of camera angle pictu res 
about one live coverage or one story as a plurality of 

25 elementary streams of the video information as one 
show or program enables the user to freely change in 
real time the pictures of the desired elementary streams 
one to another and to watch them, while the user is 
watching this one show or program through a tuner. 

30 

Disclosure of Invention 

[0005] However, in the above described DVD, al- 
though the video of one stream can be multiplexed and 

35 recorded with the audio information, the sub picture in- 
formation, and the like of a plurality of streams, the vid- 
eos of the plurality of streams cannot be multiplexed and 
recorded. Namely, the DVD, on which recording is per- 
formed on the basis of the program stream format of the 

40 MPEG 2, has such a problem that a plurality of shows 
or programs cannot be essentially multiplexed and re- 
corded thereon, which are transmitted at that same time 
in the transport stream format of the MPEG 2 as de- 
scribed above. 

45 [0006] Moreover, even if there is a disc which has 
such a high transmission rate and has such a high re- 
cording capacity or such a high recording density as to 
be capable of recording at the same time the plurality of 
shows or programs transmitted in the transport stream 

50 format, the DVD still has such a technical problem that 
it is difficult or almost impossible to judge which elemen- 
tary stream pair or group (e.g. a pair of a video stream 
and an audio stream, a group obtained adding a sub 
picture stream to the above pair) corresponds to a de- 

55 sired show or program to reproduce from among a plu- 
rality of elementary streams in a bundle, when repro- 
ducing the disc. 

[0007] Furthermore, in the case of the multiple broad- 
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casting described above, an interpretation rule on the 
tuner side when the elementary streams of a plurality of 
video information corresponding to a plurality of pro- 
grams for one show are transmitted at the same time 
and an interpretation rule on the tuner side when the s 
elementary streams of a plurality of video information 
corresponding to one program for one show are trans- 
mitted at the same time, can be freely determined as a 
local rule for each country or each district, according to 
the transport stream format of the MPEG 2. Therefore, 
even if there is the disc, which has such a high trans- 
mission rate and has such a high recoding capacity or 
such a high recording density as to be capable of re- 
cording at the same time the plurality of shows or pro- 
grams transmitted in the transport stream format of the 
M PEG 2, in the case where the plurality of shows, whose 
interpretation rules differ from each other as the local 
rule, are recorded on this disc, there is left such a tech- 
nical problem that it is difficult or almost impossible to 
judge which elementary streams or which videos can be 
freely switched to each other, when reproducing the 
disc. Especially, in the case of recording on one disc the 
multiple-broadcasted show whose interpretation rules 
differ as described above, it is conceivable that the han- 
dling or response by an information reproducing appa- 
ratus must be complicate and difficult. Alternatively, in 
order to enable the multiple broadcasting to be repro- 
duced in the same interpretation rules at a plurality of 
information reproducing apparatuses whose set inter- 
pretation rules differ from each other, there is left such 
a technical problem that it is necessary to apply a 
change onto the elementary stream format when re- 
cording. 

[0008] It is therefore an object of the present invention 
to provide an information recording medium, an appa- 
ratus for and a method of recording information, an ap- 
paratus for and a method of reproducing the information, 
an apparatus for and a method of recording and repro- 
ducing the information, a computer program for control- 
ling the record or the reproduction, and a data structure 
including a control signal for controlling the reproduc- 
tion, which make it possible to multiplex and record a 
plurality of shows or programs and relatively simply re- 
produce a desired one from among them. 
[0009] The above object of the present invention can 
be achieved by an information recording medium on 
which an entire stream including a plurality of portion 
streams, each of which is provided with picture informa- 
tion or audio information constituting a series of content, 
is multiplexed-and-recorded by a unit of packet, which 
is a physically accessible unit, the information recording 
medium provided with: an object data file for storing ob- 
ject data, which is a logically accessible unit and is con- 
structed by a plurality of packets, each of which stores 
therein a piece of the picture information or the audio 
information; a reproduction sequence information file for 
storing reproduction sequence information which de- 
fines a reproduction sequence of the object data stored 



in the object data file; and an object information file for 
storing, as reproduction control information for control- 
ling a reproduction of the object data file, (i) correspond- 
ence definition information which defines a correspond- 
ence relationship between a plurality of packets, which 
are multiplexed on a time axis, and the plurality of por- 
tion streams and (ii) related group definition information 
which defines as a related group a group having a spe- 
cific relation from among a plurality of series of contents 
constituting the plurality of portion streams. 
[0010] According to the information recording appa- 
ratus of the present invention, the entire stream, such 
as at least one portion of the transport stream of the 
MPEG 2, is provided with a plurality of portion streams, 
such as elementary streams. Each of the portion 
streams is provided with picture information (e.g. video 
data and sub picture data) or audio information (e.g. au- 
dio data) constituting a series of content, which can be 
reproduced by the information reproducing apparatus. 
Namely, one "portion stream" herein indicates one data 
array or information array, such as the video stream, the 
audio stream, and the sub picture stream constituting a 
series of content, which can be, for example, the ele- 
mentary stream. On the other hand, one "entire stream" 
herein indicates the data array or information array 
made by a plurality of portion streams in a bundle. The 
entire stream may be the transport stream itself made 
by m elementary streams in a bundle of the MPEG 2 (m: 
natural number, m^2). The entire stream may be the 
data array or information array made by n elementary 
streams in a bundle out of the transport stream(n: nat- 
ural number, 2gn<m). The entire stream of this type is 
multiplexed-and-recorded on the information recording 
medium by a unit of packet (e.g. a TS packet as de- 
scribed later), which is a physically accessible unit, by 
the information reproducing apparatus. Especially, the 
object data file is a logically accessible unit by the infor- 
mation reproducing apparatus and stores the object da- 
ta constructed by a plurality of packets, each of which 
stores therein a piece of the picture information or the 
audio information. The reproduction sequence informa- 
tion file stores the reproduction sequence information 
(e.g. play list information), which defines the reproduc- 
tion sequence of the object data stored in this object da- 
ta file. The object information file stores, as the repro- 
duction control information for controlling the reproduc- 
tion of the object data file by the information reproducing 
apparatus, (i) the correspondence definition information 
(e.g. an ES_Map Table indicating an elementary stream 
packet ID (ES_PID), as described later) and (ii) the re- 
lated group definition information (e.g. AU information 
or an AU information table as described later). Various 
information stored in the object information file and the 
reproduction sequence information file described above 
is not multiplexed by a unit of packet on the information 
recording medium, which is different from the case of 
the object data file. Therefore, on the basis of the repro- 
duction control information and the reproduction se- 



15 



20 



25 



30 



35 



40 



45 



50 



3 



5 



EP 1 469 677 A1 



6 



quence information, it becomes possible to reproduce 
the object data on the information reproducing appara- 
tus. Especially, in this case, in the information reproduc- 
ing apparatus, it becomes possible to reproduce a de- 
sired show or program constructed by the combination 
of the picture information and the audio information con- 
sisting of one portion of the entire stream which is mul- 
tiplexed and recorded on the information recording me- 
dium, on the basis of the correspondence relationship 
between a plurality of packets and a plurality of portion 
streams multiplexed on the time axis (e.g., at a same 
time point on the time axis of recording or reproducing 
a plurality of portion streams) and described in the cor- 
respondence definition information included in the re- 
production control information. Moreover, it is possible 
to relatively easily reproduce a desired one of a plurality 
of shows or programs, which are multiplexed and re- 
corded, by specifying a plurality of portion streams cor- 
responding this desired shows or programs (e.g. a pair 
of the video stream and the audio stream, a group ob- 
tained adding the sub picture stream to the above pair) 
on the basis of the related group (e.g. the AU as de- 
scribed later) which has a specific relation from among 
a plurality of series of contents constituting the plurality 
of portion streams and which is described in the related 
group definition information included in the reproduction 
control information. In addition, on the basis of this re- 
lated group, it becomes possible to easily recognize, at 
the information reproducing apparatus side, the related 
group having a specific relationship, such as multi-vision 
broadcasting, multi-view broadcasting, bilingual broad- 
casting, and bilingual caption broadcasting. 
[0011] Consequently, even if the content is compli- 
cate such that one show or program is constructed from 
a plurality of portion streams, it becomes possible to re- 
produce it without any problem according to the related 
group definition information on the information recording 
medium, independently of a definition rule or an inter- 
pretation rule (e.g. the contents of a PAT and a PMT as 
described later) which is packetized in the transport 
stream at the time of the transmission of these contents. 
Moreover, this type of record is performed not by apply- 
ing a change onto the data structure of such a transport 
stream that a plurality of TV channel shows or programs 
are digital-broadcasted at the same time, but by record- 
ing the object information file, the reproduction se- 
quence information file, and the like, in addition to the 
data structure, which is extremely useful in practice. 
[0012] In one aspect of the information recording me- 
dium of the present invention, the object information file 
further stores, as the reproduction control information, 
sub group definition information which defines as a sub 
group a group of the plurality of portion streams mutually 
changeable by an information reproduction apparatus 
in the related group. 

[0013] Accordingto this aspect, the object information 
file stores the sub group definition information (e.g. PU 
information as described later) as one of the reproduc- 



tion control information to control the reproduction of the 
object data file by the information reproducing appara- 
tus. Therefore, on the basis of the sub group (e.g. the 
PU as described later) of the plurality of portion streams 

5 mutually changeable by the information reproduction 
apparatus within the related group, it is possible to easily 
recognize the elementary stream, which can be freely 
switched over, within the related group having a specific 
relationship, such as multi-vision broadcasting, multi- 

10 view broadcasting, bilingual broadcasting, and bilingual 
caption broadcasting. 

[0014] In another aspect of the information recording 
medium of the present invention, the related group def- 
inition information defines such that a same content may 
15 commonly belong to two or more groups, each of which 
is defined as the related group. 

[001 5] According to this aspect, the same content can 
be commonly used between a plurality of related groups 
when reproducing, which helps to save a recording ca- 

20 pacity on the information recording medium. 

[0016] In another aspect of the information recording 
medium of the present invention, the sub group defini- 
tion information defines such that a same portion stream 
may commonly belong to two or more groups, each of 

25 which is defined as the sub group. 

[001 7] According to this aspect, the same content can 
be commonly used between a plurality of sub groups 
when reproducing, which helps to save a recording ca- 
pacity on the information recording medium. 

30 [0018] In another aspect of the information recording 
medium of the present invention, the entire stream in- 
cludes two or more portion streams each constructed 
by main picture information which is the series of content 
as the picture information. 

35 [0019] According to this aspect, it is possible to col- 
lectively record, by multiplexing and recording, the en- 
tire stream, such as the transport stream of the MPEG 
2, which includes two or more portion streams (i.e. the 
video stream) each constructed by video information 

40 (main picture information), which is useful. 

[0020] In another aspect of the information recording 
medium of the present invention, the entire stream in- 
cludes (i) the portion stream constructed by main picture 
information which is the series of content as the picture 

45 information and (ii) the portion stream constructed by 
sub picture information which is the series of content as 
the picture information. 

[0021] According to this aspect, it is also possible to 
multiplex the portion stream (i.e. the sub picture stream) 

50 constructed by the sub picture information for adding 
subtitles, captions or the like, into the entire stream. In 
this case, it is also possible to correlate a plurality of 
portion streams constructed by a plurality of sub picture 
information, with one portion stream constructed by one 

55 video information (main picture information). 

[0022] In another aspect of the information recording 
medium of the present invention, the entire stream is 
provided with at least one portion of a transport stream 



4 



7 



EP 1 469 677 A1 



8 



of MPEG 2 and the related group definition information 
defines as the related group a group having a multi 
broadcasting relationship from among the plurality of se- 
ries of contents. 

[0023] According to this aspect, since the related 
group definition information defines the related group 
having a multi broadcasting relationship by the transport 
stream, even if the multi broadcasting is collectively re- 
corded onto the information recording medium, it be- 
comes possible to appropriately reproduce the multi 
broadcasting on the basis of the related group informa- 
tion. 

[0024] In another aspect of the information recording 
medium of the present invention, the related group def- 
inition information includes what defines as the related 
group the plurality of series of contents corresponding 
to one show constructed by a plurality of programs. 
[0025] According to this aspect, even in the case of 
defining, by a local rule such as a rule for each country, 
the plurality of series of contents corresponding to one 
show constructed by a plurality of programs as a group 
constituting the multi broadcasting or the like, the repro- 
duction corresponding to the multi broadcasting or the 
like can be performed from the information multiplexed 
and recorded on the information recording medium, on 
the basis of the related group information. 
[0026] Alternatively, in another aspect of the informa- 
tion recording medium of the present invention, the re- 
lated group definition information includes what defines 
as the related group the plurality of series of contents 
corresponding to one show constructed by one pro- 
gram. 

[0027] According to this aspect, even in the case of 
defining, by a local rule such as a rule for each country, 
the plurality of series of contents corresponding to one 
show constructed by one program as a group constitut- 
ing the multi broadcasting or the like, the reproduction 
corresponding to the multi broadcasting or the like can 
be performed from the information multiplexed and re- 
corded on the information recording medium; on the ba- 
sis of the related group information. 
[0028] The above object of the present invention can 
be achieved by an information recording apparatus for 
multiplexing and recording an entire stream by a unit of 
packet which is a physically accessible unit onto an in- 
formation recording medium, the entire stream including 
a plurality of portion streams each of which is provided 
with picture information or audio information constituting 
a series of content, the information recording apparatus 
provided with: a first recording device for recording an 
object data file, the object data file storing object data, 
which is a logically accessible unit and is constructed by 
a plurality of packets, each of which stores therein a 
piece of the picture information or the audio information; 
a second recording device for recording a reproduction 
sequence information file, the reproduction sequence 
information file storing reproduction sequence informa- 
tion which defines a reproduction sequence of the object 



data stored in the object data file; and a third recording 
device for recording an object information file, the object 
information file storing, as reproduction control informa- 
tion for controlling a reproduction of the object data file, 
s (i) correspondence definition information which defines 
a correspondence relationship between a plurality of 
packets, which are multiplexed on a time axis, and the 
plurality of portion streams and (ii) related group defini- 
tion information which defines as a related group a 
group having a specific relation from among a plurality 
of series of contents constituting the plurality of portion 
streams. 

[0029] According to the information recording appa- 
ratus of the present invention, the object data file for 
storing the object data is recorded by the first recording 
device, such as a system controller, an encoder, a TS 
object generator as described later, and an optical pick- 
up or the like. The reproduction sequence information 
file for storing the reproduction sequence information is 
recorded by the second recording device, such as a sys- 
tem controller and an optical pickup or the like. The ob- 
ject information file for storing the correspondence def- 
inition information and the related group definition infor- 
mation is recorded by the third recording device, such 
as a system controller and an optical pickup or the like, 
as the reproduction control information. Therefore, it is 
possible to collectively multiplex and record the entire 
stream, such as at least one portion of the transport 
stream of the MPEG 2, onto the above-described infor- 
mation recording medium of the present invention. In 
this case, although the first recording device multiplexes 
and records the object data by a unit of packet, the sec- 
ond and third recording devices do not multiplex and 
record the reproduction sequence information and the 
reproduction control information by a unit of packet, re- 
spectively. 

[0030] Incidentally, the information recording appara- 
tus of the present invention can also employ various as- 
pects in response to various aspects of the above-de- 
scribed information recording medium of the present in- 
vention. 

[0031] In one aspect of the information recording ap- 
paratus of the present invention, the entire stream is pro- 
vided with at least one portion of a transport stream of 
MPEG 2, which is digitally-transmitted and is received 
at a set box. 

[0032] According to this aspect, the entire streams, 
such as at least one portion of the transport stream of 
the MPEG 2 (i.e. a portion corresponding to TV shows 
50 or TV programs of all channels or a plurality of chan- 
nels), which is digitally-transmitted and broadcasted, 
can be multiplexed and recorded onto the information 
recording medium in real time, which is extremely use- 
ful. 

55 [0033] The above object of the present invention can 
be achieved by an information recording method of mul- 
tiplexing and recording an entire stream by a unit of 
packet which is a physically accessible unit onto an in- 
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formation recording medium, the entire stream including 
a plurality of portion streams each of which is provided 
with picture information or audio information constituting 
a series of content, the information recording method 
provided with: a first recording process of recording an 
object data file, the object data file storing object data, 
which is a logically accessible unit and is constructed by 
a plurality of packets, each of which stores therein a 
piece of the picture information or the audio information; 
a second recording process of recording a reproduction 
sequence information file, the reproduction sequence 
information file storing reproduction sequence informa- 
tion which defines a reproduction sequence of the object 
data stored in the object data file; and a third recording 
process of recording an object information file, the ob- 
ject information file storing, as reproduction control in- 
formation for controlling a reproduction of the object da- 
ta file, (i) correspondence definition information which 
defines a correspondence relationship between a plu- 
rality of packets, which are multiplexed on a time axis, 
and the plurality of portion streams and (ii) related group 
definition information which defines as a related group 
a group having a specific relation from among a plurality 
of series of contents constituting the plurality of portion 
streams. 

[0034] According to the information recording method 
of the present invention, the object data file for storing 
the object data is recorded by the first recording proc- 
ess. The reproduction sequence information file for stor- 
ing the reproduction sequence information is recorded 
by the second recording process. The object information 
file for storing the correspondence definition information 
and the related group definition information is recorded 
by the third recording process. Therefore, it is possible 
to collectively multiplex and record the entire stream, 
such as at least one portion of the transport stream of 
the MPEG 2, onto the above-described information re- 
cording medium of the present invention. In this case, 
although the first recording process multiplexes and 
records the object data by a unit of packet, the second 
and third recording processes do not multiplex and 
record the reproduction sequence information and the 
reproduction control information by a unit of packet, re- 
spectively. 

[0035] Incidentally, the information recording method 
of the present invention can also employ various as- 
pects in response to various aspects of the above-de- 
scribed information recording medium of the present in- 
vention. 

[0036] In one aspect of the information recording 
method of the present invention, the entire stream is pro- 
vided with at least one portion of a transport stream of 
MPEG 2, which is digitally-transmitted and is received 
at a set box. 

[0037] According to this aspect, the entire stream, 
such as at least one portion of the transport stream of 
the MPEG 2, which is digitally-transmitted and broad- 
casted, can be multiplexed and recorded onto the infor- 



mation recording medium in real time, which is extreme- 
ly useful. 

[0038] The above object of the present invention can 
be achieved by an information reproducing apparatus 
s for reproducing one portion of the recorded entire 
stream from the above-described information recording 
medium of the present invention (including its various 
aspects), the information reproducing apparatus provid- 
ed with: a reading device for physically reading the in- 
to formation from the information recording medium; and 
a reproducing device for reproducing the object data in- 
cluded in the information read by the reading device, on 
the basis of the reproduction control information and the 
reproduction sequence information included in the infor- 
ms mation read by the reading device. 

[0039] According to the information reproducing ap- 
paratus of the present invention, information is physical- 
ly read by the reading device, such as an optical pickup 
and a demodulator or the like, from the information re- 
20 cording medium by a unit of packet or the like. Then, the 
object data especially read by a unit of packet is repro- 
duced by the reproducing device, such as a system con- 
troller, a demultiplexer, and a decoder or the like, on the 
basis of the reproduction control information and the re- 
25 production sequence information included in this read 
information. Therefore, it is possible to appropriately re- 
produce, as a series of content information, the informa- 
tion multiplexed and recorded on the above-described 
information recording medium of the present invention. 
30 [0040] Incidentally, the information reproducing appa- 
ratus of the present invention can also employ various 
aspects in response to various aspects of the above- 
described information recording medium of the present 
invention. 

35 [0041] The above object of the present invention can 
be achieved by an information reproducing method of 
reproducing one portion of the recorded entire stream 
from the above-described information recording medi- 
um of the present invention (including its various as- 

40 pects), the information reproducing method provided 
with: a reading process of physically reading the infor- 
mation from the information recording medium; and a 
reproducing process of reproducing the object data in- 
cluded in the information read by the reading process, 

45 on the basis of the reproduction control information and 
the reproduction sequence information included in the 
information read by the reading process. 
[0042] According to the information reproducing 
method of the present invention, information is physical- 

50 |y read by the reading process from the information re- 
cording medium by a unit of packet or the like. Then, the 
object data especially read by a unit of packet is repro- 
duced by the reproducing process on the basis of the 
reproduction control information and the reproduction 

55 sequence information included in this read information. 
Therefore, it is possible to appropriately reproduce, as 
a series of content information, the information multi- 
plexed and recorded on the above-described informa- 
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tion recording medium of the present invention. 
[0043] Incidentally, the information reproducing meth- 
od of the present invention can also employ various as- 
pects in response to various aspects of the above-de- 
scribed information recording medium of the present in- 
vention. 

[0044] The above object of the present invention can 
be achieved by an information recording and reproduc- 
ing apparatus for recording the entire stream onto and 
reproducing one portion of the recorded entire stream 
from the above-described Information recording medi- 
um of the present invention (including its various as- 
pects), the information recording and reproducing appa- 
ratus provided with: a first recording device for recording 
the object data file onto the information recording medi- 
um; a second recording device for recording the repro- 
duction sequence information file onto the information 
recording medium; a third recording device for recording 
the object information file onto the information recording 
medium; a reading device for physically reading the in- 
formation from the information recording medium; and 
a reproducing device for reproducing the object data in- 
cluded in the information read by the reading device, on 
the basis of the reproduction control information and the 
reproduction sequence information included in the infor- 
mation read by the reading device. 
[0045] According to the information recording and re- 
producing apparatus of the present invention, as is the 
case of the above-described information recording ap- 
paratus of the present invention, the object data file is 
multiplexed and recorded by the first recording device 
by a unit of packet, the reproduction sequence informa- 
tion file is recorded by the second recording device, and 
the object information file is recorded by the third record- 
ing device. Then, as is the case of the above-described 
information reproducing apparatus of the present inven- 
tion, the information is physically read by the reading 
device from the information recording medium, and the 
object data especially read by a unit of packet is repro- 
duced by the reproducing device on the basis of the re- 
production control information and the reproduction se- 
quence information included in this read information. 
Therefore, it is possible to collectively multiplex and 
record the entire stream, such as at least one portion of 
the transport stream of the MPEG 2, onto the above- 
described information recording medium of the present 
invention, and further it is possible to appropriately re- 
produce, as a series of content information, this multi- 
plexed-and-recorded information. 
[0046] Incidentally, the information recording and re- 
producing apparatus of the present invention can also 
employ various aspects in response to various aspects 
of the above-described information recording medium 
of the present invention. 

[0047] The above object of the present invention can 
be achieved by an information recording and reproduc- 
ing method of recording the entire stream onto and re- 
producing one portion of the recorded entire stream 



from the above-described information recording medi- 
um of the present invention (including its various as- 
pects), the information recording and reproducing meth- 
od provided with: a first recording process of recording 

5 the object data file onto the information recording medi- 
um; a second recording process of recording the repro- 
duction sequence information file onto the information 
recording medium; a third recording process of record- 
ing the object information file onto the information re- 

10 cording medium; a reading process of physically read- 
ing the information from the information recording me- 
dium; and a reproducing process of reproducing the ob- 
ject data included in the information read by the reading 
process, on the basis of the reproduction control infor- 
ms mation and the reproduction sequence information in- 
cluded in the information read by the reading process. 
[0048] According to the information recording and re- 
producing method of the present invention, as is the 
case of the above-described information recording 

20 method of the present invention, the object data file is 
multiplexed and recorded by the first recording process 
by a unit of packet, the reproduction sequence informa- 
tion file is recorded by the second recording process, 
and the object information file is recorded by the third 

25 recording process. Then, as is the case of the above- 
described information reproducing method of the 
present invention, information is physically read by the 
reading process from the information recording medi- 
um, and the object data especially read by a unit of pack- 

30 et is reproduced by the reproducing process on the ba- 
sis of the reproduction control information and the re- 
production sequence information included in this read 
information. Therefore, it is possible to collectively mul- 
tiplex and record the entire stream, such as at least one 

35 portion of the transport stream of the MPEG 2, onto the 
above-described information recording medium of the 
present invention, and further it is possible to appropri- 
ately reproduce, as a series of content information, this 
multiplexed-and-recorded information. 

40 [0049] Incidentally, the information recording and re- 
producing method of the present invention can also em- 
ploy various aspects in response to various aspects of 
the above-described information recording medium of 
the present invention. 

45 [0050] The above object of the present invention can 
be achieved by a computer program for controlling 
record which controls a computer provided in the above- 
described information recording apparatus of the 
present invention (including its various aspects) and 

so which causes the computer to function as at least one 
portion of the first recording device, the second record- 
ing device, and the third recording device. 
[0051 ] According to the computer program for control- 
ling record of the present invention, the above described 

55 information recording apparatus of the present invention 
can be relatively easily realized as a computer reads 
and executes the computer program from a program 
storage device, such as a ROM, a CD-ROM, a 
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DVD-ROM, and a hard disk or the like, or as it executes 
the computer program after downloading the program 
through a communication device. 
[0052] The above object of the present invention can 
be achieved by a computer program for controlling re- 5 
production which controls a computer provided in the 
above-described information reproducing apparatus of 
the present invention (including its various aspects) and 
which causes the computer to function as at least one 
portion of the reproducing device. 
[0053] Accordi ng to the computer program for control- 
ling reproduction of the present invention, the above de- 
scribed information reproducing apparatus of the 
present invention can be relatively easily realized as a 
computer reads and executes the computer program 
from a program storage device, such as a ROM, a 
CD-ROM, a DVD-ROM, and a hard disk or the like, or 
as it executes the computer program after downloading 
the program through a communication device. 
[0054] The above object of the present invention can 
be achieved by a computer program for controlling 
record and reproduction which controls a computer pro- 
vided in the above-described information recording and 
reproducing apparatus of the present invention (includ- 
ing its various aspects) and which causes the computer 
to function as at least one portion of the first recording 
device, the second recording device, the third recording 
device, and the reproducing device. 
[0055] According to the computer program for control- 
ling record and reproduction of the present invention, 
the above described information recording and repro- 
ducing apparatus of the present invention can be rela- 
tively easily realized as a computer reads and executes 
the computer program from a program storage device, 
such as a ROM, a CD-ROM, a DVD-ROM, and a hard 
disk or the like, or as it executes the computer program 
after downloading the program through a communica- 
tion device. 

[0056] The above object of the present invention can 
be also achieved by a data structure in which an entire 
stream including a plurality of portion streams, each of 
which is provided with picture information or audio infor- 
mation constituting a series of content, is multiplexed by 
a unit of packet, which is a physically accessible unit, 
provided with: an object data file for storing object data, 
which is a logically accessible unit and is constructed by 
a plurality of packets, each of which stores therein a 
piece of the picture information or the audio information; 
a reproduction sequence information file for storing re- 
production sequence information which defines a repro- 
duction sequence of the object data stored in the object 
data file; and an object information file for storing, as 
reproduction control information for controlling a repro- 
duction of the object data file, (i) correspondence defi- 
nition information which defines a correspondence rela- 
tionship between a plurality of packets, which are mul- 
tiplexed on a time axis, and the plurality of portion 
streams and (ii) related group definition information 



which defines as a related group a group having a spe- 
cific relation from among a plurality of series of contents 
constituting the plurality of portion streams. 
[0057] According to the data structure of the present 
invention, as is the case of the information recording me- 
dium of the present invention, even if the content is com- 
plicate such that one show or program is constructed 
from a plurality of portion streams, it becomes possible 
to reproduce it without any problem according to the re- 
lated group definition information, independently of a 
definition rule or an interpretation rule (e.g. the contents 
of a PAT and a PMT as described later) which is pack- 
etized in the transport stream at the time of the trans- 
mission of these contents. 

[0058] These functions and other advantages of the 
invention will be apparent from the following description 
of embodiments. Mowing description of embodiments. 
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Brief Description of Drawings 

20 

[0059] 

FIG. 1 is a diagram showing a basic structure of an 
optical disc as being one embodiment of an infor- 
ms mation recording medium of the present invention, 
the upper part being a schematic plan view of the 
optical disc having a plurality of areas, the corre- 
sponding bottom part being an schematic diagram 
of the area structure in the radial direction; 
30 FIGs. 2 are a schematic diagram of the convention- 
al program stream of the MPEG 2 (FIG. 2(a)) and a 
schematic diagram of the transport stream of the 
MPEG 2 used in the embodiment (FIG. 2(b)); 
FIG. 3 is a schematic diagram showing a datastruc- 
35 ture recorded on the optical disc in the embodiment; 
FIG. 4 is a schematic diagram showing details of 
the data structure in each object shown in FIG. 3; 
FIG. 5 is a schematic diagram showing that an ele- 
mentary stream for a program #1 at an upper level 
40 and an elementary stream for a program #2 at a 
middle level are multiplexed, constituting a trans- 
port stream for these two programs at a low level, 
with the horizontal axis as a time axis; 
FIG. 6 is a schematic diagram showing the image 
45 of TS packets multiplexed in one transport stream 
as a packet alignment along time; 
FIG. 7 is a schematic diagram showing the logical 
construction of data on the optical disc in the em- 
bodiment, focusing on the development of a logical 
50 hierarchy to an object hierarchy or an entity hierar- 
chy; 

FIG. 8 is a schematic diagram showing two specific 
examples of the logical construction in a play list 
constituting one title shown in FIG. 7; 
55 FIG. 9 is a block diagram showing an information 
recording / reproducing apparatus related to the 
embodiment of the present invention; 
FIG. 10 is a flow chart showing a record operation 
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(part 1) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 11 is a flow chart showing a record operation 
(part 2) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 12 is a flow chart showing a record operation 
(part 3) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 13 is a flow chart showing a record operation 
(part 4) of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 14 is a flow chart showing a reproduction op- 
eration of the information recording / reproducing 
apparatus in the embodiment; 
FIG. 15 is a schematic diagram showing an entire 
access flow in reproducing, in relation to the logical 
structure of the optical disc in the embodiment; 
FIG. 16 is a schematic diagram showing the data 
structures of TS objects #1 and #2 including a plu- 
rality of transport streams in one specific example 
of the embodiment; 

FIG. 17 is a schematic diagram showing the data 
structures of a PAT and a PMT of the TS object #1 
in one specific example of the embodiment; 
FIG. 18 is a schematic diagram showing the data 
structures of a PAT and a PMT of the TS object #2 
in one specific example of the embodiment; 
FIG. 19 is a schematic diagram showing the data 
structure of the TS object #3 in one specific example 
of the embodiment; 

FIG. 20 is a schematic diagram showing the data 
structures of a PAT and a PMT of the TS object #3 
in one specific example of the embodiment; 
FIG. 21 is a schematic diagram showing the data 
structure finally constructed on the optical disc in 
one specific example of the embodiment; 
FIG. 22 is a schematic diagram showing one spe- 
cific example of the data structure of a disc informa- 
tion file in one specific example of the embodiment; 
FIG. 23 is a schematic diagram showing one spe- 
cific example of the data structure of a title informa- 
tion table included in the disc information file in one 
specific example of the embodiment; 
FIG. 24 is a schematic diagram showing one spe- 
cific example of the data structure of a play list in- 
formation table constructed in a play list information 
file in one specific example of the embodiment; and 
FIG. 25 is a schematic diagram showing one spe- 
cific example of the data structures of an AU table 
constructed in an object information file and an ES 
map table related to the AU table in one specific ex- 
ample of the embodiment. 

Best Mode for Carrying Out the Invention 

[0060] The best mode for carrying out the present in- 
vention will be hereinafter explained in order, for each 
embodiment with reference to the drawings. 



(Information Recording Medium) 

[0061] The embodiment of an information recording 
medium of the present invention will be explained with 

s reference to FIG. 1 to FIG. 8. In this embodiment, the 
information recording medium of the present invention 
is applied to an optical disc of a type capable of record- 
ing (writing) and reproducing (reading). 
[0062] Firstly, the basic structure of the optical disc in 

10 the embodiment will be explained with reference to FIG. 
1 . The upper part of FIG. 1 is a schematic plan view of 
the optical disc structure having a plurality of areas, and 
the bottom part is a schematic diagram of the area struc- 
ture in its radial direction 

15 [0063] As shown in FIG. 1 , an optical disc 100 is re- 
cordable in various recoding methods, such as a mag- 
net-optical method and a phase transition method, onto 
which it is possible to record (write) information a plural- 
ity of times or only once. It is provided with a lead-in area 

20 104, a data record area 106, and a lead-out area 108 
on a recording surface on the disc main body, which is 
about 12 cm in diameter, as is the DVD, with a center 
hole 102 as the center, in the direction from the inner 
circumference to the outer circumference. In each area, 

25 groove tracks and land tracks are alternately placed spi- 
rally or coaxially with the center hole 1 02 as the center, 
for example. These groove tracks may be wobbled, and 
pre-pits may be formed on either or both of the tracks. 
Incidentally, the present invention is not specially limited 

30 to an optical disc having these three areas. 

[0064] Secondly, the configuration of a transport 
stream (TS) recorded on the optical disc of the present 
invention will be explained with reference to FIG. 2(a) 
and FIG. 2(b). FIG. 2(a) is a schematic diagram showing 

35 the configuration of a conventional program stream of 
the MPEG 2, as a comparison. FIG. 2(b) is a schematic 
diagram showing the configuration of the transport 
stream (TS) of the MPEG 2. 

[0065] In FIG. 2(a), one program stream includes (i) 

40 only one video stream for video data as being the video 
information, and further (ii) at most 8 audio streams for 
audio data as being the audio information, and also (iii) 
at most 32 sub picture streams for sub picture data as 
being the sub picture information, along a time axis t. 

45 Namely, the video data multiplexed at an arbitrary time 
tx is related to only the one video stream. For example, 
a plurality of video streams corresponding to a plurality 
of TV shows or movies cannot be included in the pro- 
gram stream at the same time. In order to multiplex the 

so TV show and the like accompanying pictures and trans- 
mit or record them, at least one video stream is required 
for each TV show and the like, so that the program 
stream format in which only one video stream exists 
cannot allow the plurality of TV shows and the like to be 

55 transmitted or recorded after multiplexing them. 

[0066] In FIG. 2(b), one transport stream (TS) in- 
cludes (i) a plurality of video streams, as an elementary 
stream (ES) for the video data as being the video infor- 
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mation, and further (ii) a plurality of audio streams, as 
an elementary stream (ES) for the audio data as being 
the audio information, and also (iii) a plurality of sub pic- 
ture streams, as an elementary stream (ES) for the sub 
picture data as being the sub picture information. Name- 
ly, the video data multiplexed at an arbitrary time tx is 
related to the plurality of video streams. For example, 
the plurality of video streams corresponding to a plurality 
of TV shows or movies can be included in the transport 
stream at the same time. As described above, the trans- 
port stream format whose transmission rate is high and 
in which there are the plurality of video streams can al- 
low the plurality of TV shows and the like to be transmit- 
ted or recorded after multiplexing them. However, digital 
broadcasting that employs an existing transport stream 
does not transmit the sub picture stream. 
[0067] Incidentally, in FIG. 2(a) and FIG. 2(b), the vid- 
eo stream, the audio stream, and the sub picture stream 
are arranged in this order from up to down for explana- 
tory convenience; however, this order is not intended to 
correspond to an order of multiplexing them in units of 
a packet, as described later, or the like. In the transport 
stream, one combination, which is one video stream, 
two audio streams, and two sub picture streams, con- 
ceptually corresponds to one show, for example. 
The optical disc 1 00 in the embodiment described above 
is constructed to multiplex-and-record onto it the trans- 
port stream (TS) including a 'plurality of elementary 
streams (ES) in the above manner., to simultaneously 
record onto it the plurality of shows or programs. 
[0068] Next, a data structure recorded on the optical 
disc 100 will be explained with reference to FIG. 3 and 
FIG. 4. FIG. 3 is a schematic diagram showing the data 
structure recorded on the optical disc 100. FIG. 4 is a 
schematic diagram showing details of the data structure 
in each object shown in FIG. 3. 

[0069] In the explanation below, a "title" is a reproduc- 
tion unit sequentially executing a plurality of "play lists", 
and is a logically large grouped unit, such as one movie 
and one TV show. The "play list" is a file for storing in- 
formation necessary for the reproduction of an "object", 
and is provided with a plurality of "Items", each of which 
stores information about the reproduction range of the 
object to access the object. More specifically, "IN point 
information" indicating a start address of the object and 
"OUT point information" indicating an end address of the 
object are written in each Item. Incidentally, these "IN 
point information" and "OUT point information" may 
show the addresses directly, or show the addresses in- 
directly by showing a time length or a time point on a 
reproduction time axis. The "object" is the entity infor- 
mation of a content constituting the transport stream of 
the MPEG 2 described above. 

[0070] In FIG. 3, the optical disc 100 is provided with 
the following four files as a logical structure: a disc in- 
formation file 110, a play (P) list information file 120, an 
object information file 130, and an object data file 140. 
It is further provided with a file system 105 to manage 



those files. Incidentally, FIG. 3 does not directly show 
the physical data alignment on the optical disc 100, but 
it is possible to record with the arrangement order shown 
in FIG. 3 corresponding to the arrangement order shown 

5 in FIG. 1 . Namely, it is possible to record the file system 
105 or the like in the lead-in area 104, and then in the 
data record area 106, and further it is also possible to 
record the object data file 140 or the like in the data 
record area 106. Even if the lead-in area 104 and/or the 

10 lead-out area 108 shown in FIG. 1 do no exist, the file 
structure shown in FIG. 3 can be constructed. 
[0071] The disc information file 110 is a file for storing 
comprehensive information about the whole optical disc 
100, and it stores disc comprehensive information 112, 

is a title information table 114, and other information 118. 
The disc comprehensive information 1 1 2 stores the total 
number of titles and the like in the optical disc 100, for 
example. The title information table 1 1 4 stores, for each 
title, each title type (e.g. a sequential reproduction type, 

20 a branch type, and the like, as described later with ref- 
erence to FIG. 8) and a play (P) list number, which con- 
stitutes each title, as logical information. 
[0072] The play list information file 120 is a reproduc- 
tion sequence information file. The play list information 

25 file 1 20 stores a play (P) list information table 1 21 , which 
indicates the logical construction of each play list and 
which is separated into play (P) list comprehensive in- 
formation 122, a play (P) list pointer 124, a plurality of 
play (P) lists 1 26 (P lists #1 to #n), and other information 

30 1 28. This play list information table 1 21 stores the logical 
information of each play list 126 in the order of the play 
list number. In other words, the storing order of each 
play list 126 is the play list number. Moreover, it is also 
possible to refer to the same play list 1 26 from a plurality 

35 of titles at the above described title information table 
1 1 4. Namely, even in the case where a title #n and a title 
#m use the same play list #p, it is possible to construct 
such that the play list #p in the play list information table 
121 is pointed at the title information table 114. 

40 [0073] The object information file 130 stores various 
attribute information about the storing position in the ob- 
ject data file 140 for each Item constituted in each play 
list 126 (i.e. a logical address that is a reproduction ob- 
ject) and about the reproduction of the Item. Especially, 

45 in this embodiment, the object information file 1 30 stores 
an AU (Associate Unit) table 131 including a plurality of 
AU information 1 32I (AU #1 to AU #n), as described later 
in detail, an ES (Elementary Stream) map table 1 34, and 
other information 138. 

so [0074] The object data file 1 40 stores a plurality of TS 
objects 142 (TS #1 object to TS #n object) for each 
transport streams (TS). Namely, it stores a plurality of 
entity data of the contents to be actually reproduced. 
[0075] Incidentally, the four files explained with refer- 

55 ence to FIG. 3 may be stored with each of them being 
separated into a plurality of files, and all of them may be 
managed or administered by the file system 105. For 
example, the object data file 140 can be separated into 
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a plurality of data files, such as an object data file #1, 
an object data file #2, ... and the like, 
[0076] As shown in FIG. 4, the TS object 142 shown 
in FIG. 3, which is a logically reproducible unit, is divided 
into a plurality of aligned units 1 43, each of which has 6 
kB data amount, for example. The head of the aligned 
units 143 corresponds to (or is "aligned" with) the head 
of the TS object 142. Each aligned unit 143 is further 
segmentized into a plurality of source packets 1 44, each 
of which has 1 92 B data amount. The source packet 144 
is a physically reproducible unit, and by using this unit, 
i.e. by a unit of packet, at least the video data, the audio 
data, and the sub picture data are multiplexed among 
the data on the optical disc 1 00. The other information 
may be also multiplexed in this manner. Each source 
packet 144 includes: control information 145, which has 
4 B data amount, for controlling the reproduction, such 
as a packet arrival time stamp indicating a reproduction 
start time point (i.e. a time point of starting demultiplex- 
ing) of the TS (transport stream) packet on a reproduc- 
tion time axis etc.; and aTS packet 146, which has 188B 
data amount. The TS packet 146 has a packet header 
1 46a at the head portion thereof. The video data is pack- 
etized to be a "video packet", the audio data is pack- 
etized to be an "audio packet", the sub picture data is 
packetized to be a "sub picture packet", or the other data 
is packetized. 

[0077] Next, with reference to FIG. 5 and FIG. 6, it will 
be explained the multiple record of the video data, the 
audio data, the sub picture data, and the like, which are 
in the transport stream format as shown in FIG. 2(b), on 
the optical disc 100 by theTS packet 146 shown in FIG. 
4. FIG. 5 is a schematic diagram showing that an ele- 
mentary stream (ES) for a program #1 (PG 1) at the up- 
per level in the figure and an elementary stream (ES) 
for a program #2.(PG 2) at the middle level in the figure 
are multiplexed, constituting a transport stream (TS) for 
these two programs (PG 1 & PG 2) at the lower level in 
the figure, with the horizontal axis as a time axis. FIG. 
6 is a schematic diagram showing the image of TS pack- 
ets multiplexed in one transport stream (TS) as a packet 
alignment along time. 

[0078] As shown in FIG. 5, the TS packets 146 with 
the video data for the program #1 packetized are dis- 
cretely arranged with respect to the time axis in the el- 
ementary stream for the program #1 (the upper one), for 
example. The TS packets 146 with the video data for 
the program #2 packetized are discretely arranged with 
respect to the time axis in the elementary stream for the 
program #2 (the middle one), for example. Then, these 
TS packets 1 46 are multiplexed, constructing the trans- 
port stream (the lower one) for those two programs. In- 
cidentally, this is omitted in FIG. 5 for explanatory con- 
venience, but in fact, the elementary stream provided 
with the TS packets in which the audio data is pack- 
etized and the sub picture stream provided with the TS 
packets in which the sub picture data is packetized may 
be multiplexed as the elementary stream for the pro- 



gram #1 in the same manner as shown in FIG. 2(b). 
Moreover, in addition to these, the elementary stream 
provided with the TS packets in which the audio data is 
packetized and the sub picture stream provided with the 
s TS packets in which the sub picture data is packetized 
may be multiplexed as the elementary stream for the 
program #2 in the same manner. 

[0079] As shown in FIG. 6, in this embodiment, one 
TS stream is constructed from many TS packets 146 

10 multiplexed as described above. Then, the many TS 
packets 146 in this multiplexed form obtain the control 
information 145 such as the packet arrival time stamp 
or the like, and are multiplexed-and-recorded on the op- 
tical disc 1 00. Incidentally, "Element (iOj)" is used in FIG. 

15 6 for the TS packet 146 comprising data which consti- 
tutes the program #i (i = 1, 2, 3), with j G = 1, 2, ...) as a 
number indicating the order for each stream which con- 
stitutes the program. This (iOj) is a packet ID, which is 
the identification number of the TS packet 146 for each 

20 elementary stream. A specific value is given to this pack- 
et ID between the plurality of TS packets 146 multi- 
plexed on the time axis (e.g., on the time axis of record- 
ing or reproducing a plurality of elementary streams) so 
that the plurality of TS packets 1 46 can be mutually dis- 
ss tinguished even if they are multiplexed on the time axis. 
[0080] In FIG. 6, a PAT (Program Associate Table) 
and a PMT (Program Map Table) are also packetized in 
the unit of the TS packet 146 and are multiplexed. 
Among them, the PAT stores a table indicating a plurality 

30 of PMT packet IDs. Especially, with regard to the PAT, 
the MPEG 2 standard defines the addition of (000), as 
shown in FIG. 6, as a predetermined packet ID. Namely, 
it is constructed such that the TS packet 146 in which 
the PAT is packetized is detected as the TS packet 146 

35 with its packet ID (000) from among many packets mul- 
tiplexed on the time axis. The PMT stores a table indi- 
cating the packet ID for each elementary stream consti- 
tuting each program with respect to one or a plurality of 
programs. To the PMT, an arbitrary packet ID may be 

40 added, but the packet ID of the PMT is indicated by the 
PAT detectable having the packet ID as (000), as de- 
scribed above. Therefore, the TS packets 146 in each 
of which the PMT is packetized (i.e. the TS packets 146 
with the packet IDs (1 00), (200), and (300) added in FIG. 

45 6) are detected by virtue of the PAT from among many 
packets multiplexed on the time axis. 
[0081] In the case where the transport stream is dig- 
ital-transmitted as shown in FIG. 6, the tuner can pick 
up the packets corresponding to the desired elementary 

50 stream from among the multiplexed packets by referring 
to the PAT and the PMT as constructed above, and de- 
modulate them. 

[0082] In this embodiment, the TS packet 146 stored 
in the TS object 1 42 shown in FIG. 4 includes these PAT 
55 and PMT packets. Namely, when the transport stream 
shown in FIG. 6 is transmitted, it can be recorded onto 
the optical disc 1 00 as it is, which is a great advantage. 
[0083] Moreover, in this embodiment, the PAT and 
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PMT as recorded above are not referred to when repro- 
ducing the optical disc 100. Instead, referring to the AU 
table 131 and the ES map table 134, as shown in FIG. 
3 and as described later in detail, allows more effective 
reproduction, and also enables complicate multi-vision s 
reproduction and the like to be treated with. On that ac- 
count, in this embodiment, the corresponding relation- 
ship between the elementary stream and the packet, 
which are obtained by referring to the PAT and the PMT 
when demodulating and recording, is stored in the ob- 
ject information file 130 in the form of the AU table 131 
and the ES map table 134 without packetizing nor mul- 
tiplexing. 

[0084] Next, the logical construction of the data on the 
optical disc 100 will be explained with reference to FIG. 
7 and FIG. 8. FIG. 7 is a schematic diagram showing 
the logical construction of the data on the optical disc 
1 00, focusing on the development of a logical hierarchy 
to an object hierarchy or an entity hierarchy. FIG. 8 is a 
schematic diagram showing two specific examples of 
the logical construction in the play (P) list constituting 
one title shown in FIG. 7. 

[0085] In FIG. 7, the optical disc 100 records one or 
a plurality of titles 200, each of which is a logically large 
unit, such as one movie or one TV show. Each title 200 
is logically constructed from one or a plurality of play 
lists 126. In each title 200, the plurality of play lists 126 
may have a sequential structure or a branch structure, 
which will be described later with reference to FIG. 8. 
Incidentally, in the case of a simple logical construction, 
one title 200 is constructed by one play list 126. More- 
over, one play list 126 can be referred to from the plu- 
rality of titles 200. 

[0086] Each play list 1 26 is logically constructed from 
a plurality of Items (i.e. , the play items) 204. In each play 
list 1 26, the plurality of Items 204 may have the sequen- 
tial structure or the branch structure. Moreover, one Item 
204 can be referred to from the plurality of play lists 1 26. 
The reproduction range of the TS object 142 is logically 
specified by the above described IN point information 
and OUT point information written in the Item 204. Then, 
by referring to object information 130d with respect to 
the reproduction range logically specified, the reproduc- 
tion range of the TS object 142 is physically specified. 
Here, the object information 130d includes various in- 
formation to reproduce the TS object 142, such as the 
attribute information of theTS object 142 and EP (Entry 
Pass) map information 134d required for a data search 
in the TS object 1 42 (incidentally, the ES map table 1 34 
shown in FIG. 3 includes a plurality of such EP map in- 
formation 134d). 

[0087] When reproducing the TS object 1 42 by an in- 
formation recording / reproducing apparatus, which will 
be described later, a physical address to be reproduced 
in the TS object 142 is obtained from the Item 204 and 
the object information 1 30d, and the desired elementary 
stream is reproduced. 

[0088] In this embodiment, as described above, the 



association from the logical hierarchy to the object hier- 
archy of the reproduction sequence is made by the IN 
point information and the OUT point information de- 
scribed in the Item 204 and by the EP map information 
134d described in the ES map table 134 (refer to FIG. 
3) of the object information 130d, which enables the el- 
ementary stream to be reproduced. 
[0089] Especially in this embodiment, the title 200 is 
classified broadly into two categories: "one play list type 
title" and "a plurality of play lists type title", and the latter 
is further categorized into what is constructed by a "se- 
quential play list" and what is constructed by a "branch 
play list". 

[0090] Among them, in the title 200 constructed by 
"the sequential play list", the play lists #1, #2, and #3 
are sequentially reproduced by simply following the re- 
production time axis, as shown in the upper part of FIG. 
8. In this case, the reproduction order corresponds to 
the play list number, and therefore, all of the play list 
numbers are stored in the reproduction order in the per- 
tinent title #n information. 

[0091] On the other hand, in the title 200 constructed 
by "the branch play list", as shown in the lower part of 
FIG. 8, the play list #2 or #3 is selectively reproduced 
following the play list #1 , and further, the play list #4 or 
#6 is selectively reproduced following the play list #2. In 
this case, with regard to the reproduction order, the play 
list 126 to be reproduced next is determined by the 
branch condition when finishing the reproduction of the 
play lists 126 in the title. Therefore, the arrangement or- 
der of the play lists 126 in the title #n information does 
not correspond to the reproduction order. Only the play 
list 1 26 at the head position is specified. The branch con- 
dition is stored in the other areas. Because of this, it is 
possible to choose either of the play lists 126 by an au- 
dience's interactive operation, for example. 
[0092] Even in the any case of the titles shown in FIG. 
8, it is constructed by one or more play lists 126. Espe- 
cially in this embodiment, it is possible to multiplex and 
to record a plurality of elementary streams in the unit of 
the TS packet 1 46. 

[0093] As described above, in this embodiment, the 
multiplexing and recording is performed on the optical 
disc 100 in units of theTS packet 146, and because of 
this, it is possible to multiplex-and-record onto the opti- 
cal disc 100 the transport stream including many ele- 
mentary streams as shown in FIG. 2(b). According to 
this embodiment, in the case of recording digital broad- 
casting onto the optical disc 1 00, a plurality of shows or 
programs can be recorded at the same time within the 
limit of the record rate. Here, it employs a method of 
multiplexing the plurality of shows or programs and re- 
cording them into oneTS object 142. The embodiment 
of an information recording / reproducing apparatus ex- 
ecutable this kind of record processing will be explained 
hereinafter. 
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(Information Recording / Reproducing Apparatus) 

[0094] Next, the embodiment of the information re- 
cording /reproducing apparatus of the present invention 
will be explained with reference to FIG. 9 to FIG. 14. 5 
FIG. 9 is a block diagram of the information recording / 
reproducing apparatus, and FIG. 10 to FIG. 14 are flow 
charts showing its operation. 

[0095] In FIG. 9, an information recording / reproduc- 
ing apparatus 500 is classified broadly into a reproduc- 
tion system and a record system, can record information 
onto the optical disc 100 described above, and can re- 
produce the information recorded on this. In this embod- 
iment, the information recording / reproducing appara- 
tus 500 Is for recording and reproducing as described 
above, but it is possible to construct an embodiment of 
the recording apparatus of the present invention from 
the record system part of the information recording / re- 
producing apparatus 500. On the other hand, it is pos- 
sible to construct an embodiment of the reproducing ap- 
paratus of the present invention from the reproduction 
system part of the information recording / reproducing 
apparatus 500. 

[0096] The information recording / reproducing appa- 
ratus 500 is provided with: an optical pickup 502; a servo 
unit 503; a spindle motor 504; a demodulator 506; a de- 
multiplexer 508; a video decoder 51 1 ; an audio decoder 
512; a sub picture decoder 51 3; an adder 51 4; a system 
controller 520; a memory 530; a modulator 606; a for- 
matter 608; a TS object generator 61 0; a video encoder 
611; an audio encoder 612; and a sub picture encoder 
613. The system controller 520 is provided with a file 
system / logical structure data generator 521 ; and a file 
system / logical structure data interpret device 522. 
Moreover, the memory 530 and a user interface 720 for 
the user input of the title information and the like are 
connected to the system controller 520. 
[0097] Among these constitutional elements, the de- 
modulator 506, the demultiplexer 508, the video decod- 
er 511, the audio decoder 512, the sub picture decoder 
513, and the adder 514 constitute the reproduction sys- 
tem, mostly. On the other hand, among these constitu- 
tional elements, the modulator 606, the formatter 608, 
the TS object generator 610, the video encoder 61 1 , the 
audio encoder 612, and the sub picture encoder 613 
constitute the record system, mostly. The optical pickup 
502, the servo unit 503, the spindle motor 504, the sys- 
tem controller 520, the memory 530, and the user inter- 
face 720 for the user input of the title information and 
the like are shared for both the reproduction system and 
the record system, mostly. Moreover, a TS object data 
source 700, a video data source 711, an audio data 
source 712, and a sub picture source 713 are prepared 
for the record system. The file system / logical structure 
data generator 521 installed in the system controller 520 
is mainly used in the record system, and the file system 
/ logical structure data interpret device 522 is mainly 
used in the reproduction system. The optical pickup 502 



irradiates a light beam LB, such as a laser beam, onto 
the optical disc 1 00 with a first power as a reading light 
when reproducing, and with a second power as a writing 
light when recording while modulating it. The servo unit 
503 is controlled by a control signal Sc1 outputted from 
the system controller 520 when reproducing and record- 
ing, and it performs a focus servo, a tracking servo, and 
the like at the optical pickup 502, as well as performing 
a spindle servo at the spindle motor 504. The spindle 
motor 504 is constructed to spin the optical disc 100 at 
a predetermined speed while receiving the spindle ser- 
vo by the servo unit 503. 



[0098] Next, the specific configuration and operation 
of each constitutional element constituting the record 
system in the information recording / reproducing appa- 
ratus 500 will be explained case by case, with reference 
to FIG. 9 to FIG. 13. 

(i-1) The case of using the already prepared TS object 

[0099] This case-will be explained with reference to 
FIG. 9 and FIG. 10. 

[0100] In FIG. 9, theTS object data source 700 is pro- 
vided with a record storage, such as a video tape and a 
memory, and it stores TS object data D1 . 
[0101] In FIG. 10, firstly, the information about each 
title (e.g. the configuration content of a program list and 
the like) logically constructed on the optical disc 1 00 us- 
ing the TS object data D1 is inputted from the user in- 
terface 720 to the system controller 520, as a user input 
12 of the title information and the like. Then, the system 
controller 520 takes in the user input 12 of the title infor- 
mation and the like obtained from the user interface 720 
(step S21 : Yes and step S22). In this case, the user in- 
terface 720 is controlled by a control signal Sc4 from the 
system controller 520, and it can perform input process- 
ing according to the content to be recorded, such as 
choosing through a title menu screen . Incidentally, in the 
case where the user input has been already performed 
or the like (step S21 : No), this processing is omitted. 
[0102] Then, theTS object data source 700 is control- 
led by a control signal Sc8 giving an instruction for read- 
ing out the data from the system controller 520, and out- 
puts the TS object data D1 . Then, the system controller 
520 takes in the TS object data D1 from the TS object 
source 700 (step S23), and performs the analysis of the 
data array of the TS object data D1 (e.g. a record data 
length and the like), the analysis of each elementary 
stream configuration (e.g. understanding of ES_PID (El- 
ementary Stream • Packet Identification number) as de- 
scribed later), and the like, by virtue of a TS analysis 
function of the file system / logical structure data gener- 
ator 521 , for example, on the basis of the PAT, the PMT, 
and the like packetized as well as the video data and 
the like as described above (step S24). 
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[0103] Then, the system controller 520 prepares the 
disc information file 1 1 0, the play list information file 1 20, 
the object information file 130, and the file system 105 
(refer to FIG, 3), as logical information file data D4, by 
virtue of the file system / logical structure data generator 5 
521 , from the user input 12 of the taken-in title informa- 
tion and the like and from the analysis results of the data 
array of the TS object data D1 and each elementary 
stream (step S25). The memory 530 is used when pre- 
paring the logical information file data D4 described 
above. 

[0104] Incidentally, such a variation that the data 
about the data array of the TS object data D1 , the data 
about the construction information of each elementary 
stream, and the like are prepared in advance, is appar- 
ently and variously conceivable. Such a variation is also 
within the scope of the embodiment. 
[0105] In FIG. 9, the formatter 608 is a device for per- 
forming a data array format to store onto the optical disc 
100 the TS object data D1 and the logical information 
file data D4. More specifically, the formatter 608 is pro- 
vided with a switch Sw1 and a switch Sw2 and is switch- 
ing-controlled by a switch control signal Sc5 from the 
system controller 520. When formatting the TS object 
data D1 , it connects the switch Sw1 to a© side and 
the switch Sw2 to the® side so as to output the TS 
object data D1 from the TS object data source 700. In- 
cidentally, the transmission control of the TS object data 
D1 is performed by the control signal Sc8 from the sys- 
tem controller 520. On the other hand, when formatting 
the logical information file data D4, the formatter 608 is 
switching-controlled by the switch control signal Sc5 
from the system controller 520, and connects the switch 
Sw2 to a@ side so as output the logical information file 
data D4. 

[0106] In a step S26 in FIG. 10, (i) the logical informa- 
tion file data D4 from the file system / logical structure 
data generator 521 in the step S25 or (ii) the TS object 
data D1 from the TS object data source 700 is outputted 
through the formatter 608 by the switching-control by the 
formatter 608 as constructed above (step S26). 
[0107] The selection output from the formatter 608 is 
transmitted to the modulator 606 as disc image data D5, 
is modulated by the modulator 606, and is recorded onto 
the optical disc 100 through the optical pickup 502 (step 
S27). The system controller 520 also executes the disc 
record control in this case. 

[0108] Then, if both the logical information file data 
D4 generated in the step S25 and the corresponding TS 
object data D2 have not been completely recorded yet, 
the operational flow returns to the step S26, continuing 
to the record (step S28: No). Incidentally, there is no 
preference in the record order of the logical information 
file data D4 and the corresponding TS object data D2. 
[0109] On the other hand, if the both have been al- 
ready recorded, it is judged whether or not the record 
on the optical disc 1 00 is supposed to be ended, on the 
basis of the presence or absence of an end command 



(step S29). If not supposed to be ended (step S29: No), 
the operational flow returns to the step S21 , continuing 
the record processing. On the other hand, if supposed 
to be ended (step S29: Yes), a series of record process- 
ing ends. 

[01 10] As described above, the information recording 
/ reproducing apparatus 500 performs the record 
processing in the case of using the already prepared TS 
object. 

[0111] Incidentally, the example in FIG. 10 shows that 
the logical information file data D4 and the correspond- 
ing TS object data D2 are outputted in the step S26, after 
preparing the logical information file data D4 in the step 
S25. However, it is also possible to execute the output 
of the TS object data D2 and/or the record of the TS 
object data D2 onto the optical disc 1 00 before the step 
S25, and after or in parallel with this recording, it is pos- 
sible to generate and record the logical information file 
data D4. 

(i-2) The case of receiving and recording the transport 
stream on air 

[0112] This case will be explained with reference to 
FIG. 9 and FIG. 11. Incidentally, in FIG. 11, the same 
steps as those in FIG. 1 0 have the same step reference 
numbers, and their explanation will be omitted as occa- 
sion demands. 

[0113] Again, in this case, the similar processing is 
performed, as is "the case of using the already prepared 
TS object" described above. Therefore, focusing on the 
differences from this case, the explanation will be done 
hereinafter. 

[0114] In the case of receiving and recording the 
transport stream on air, or the transport stream being 
broadcasted, the TS object data source 700 is provided 
with a receiver (set top box) for receiving the digital 
broadcast on air, for example, receives the TS object 
data D1 , and transmits it to the formatter 608 in real time 
(step S41). At the same time, reception information D3 
(i.e. information corresponding to the data transmitted 
through the receiver and the interface of the system con- 
troller 520) including the program construction informa- 
tion and the ES_PID information, as described later, 
which are deciphered upon receiving is taken into the 
system controller 520 and is stored into the memory 530 
(step S44). 

[0115] In the meantime, theTS object data D1 output- 
ted to the formatter 608 is outputted to the modulator 
606 by the switching-control of the formatter 608 (step 

542) , and is recorded onto the optical disc 100 (step 

543) . 

[0116] Along with these operations, using the pro- 
gram construction information and the ES_PID informa- 
tion included in the reception information D3 taken-in- 
upon receiving and stored in the memory 530, the file 
system / logical structure data generator 521 prepares 
the logical information file data D4 (step S24 and step 
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S25). Then, after completing the record of a series of 
the TS object data D1 , this logical information file data 
D4 is additionally recorded onto the optical disc 100 
(step S46 and step S47). Incidentally, these step S24 
and step S25 may be performed after the step S43. 
[0117] Moreover, as the occasion demands (e.g. in 
the case of editing one portion of the title, or the like), 
by adding the user input 12 of the title information and 
the like from the user interface 720 to the program con- 
struction information and the ES_PID information stored 
in the memory 530, it is possible to prepare the logical 
information file data D4 by the system controller 520 and 
additionally record this onto the optical disc 100. 
[0118] As described above, the information recording 
/reproducing apparatus 500 performs the record 
processing in the case of receiving the transport stream 
on air and recording it in real time. 
[0119] Incidentally, if all the reception data obtained 
when broadcasting is once stored into an archive appa- 
ratus, and then, if this is used as the TS object source 
700, the same processing as that in "the case of using 
the already prepared TS object" will do. 

(i-3) The case of recording the video data, the audio 
data, and the sub picture data 

[0120] This case will be explained with reference to 
FIG. 9 and FIG. 12. Incidentally, in FIG. 12, the same 
steps as those in FIG. 10 have the same step reference 
numbers, and their explanation will be omitted as occa- 
sion demands. 

[01 21 ] In the case of recording the video data, the au- 
dio data, and the sub picture data, which are individually 
prepared in advance, the video data source 71 1 , the au- 
dio data source 712, and the sub picture data source 
713 are individually provided with the record storage, 
such as a video tape and a memory, and store a video 
data DV, an audio data DA, and a sub picture data DS, 
respectively. 

[0122] These data sources are controlled by the con- 
trol signal Sc8 giving an instruction for reading out the 
data from the system controller 520, and they transmit 
the video data DV, the audio data DA, and the sub pic- 
ture data DS, to the video encoder 611, the audio en- 
coder 61 2, and the sub picture encoder 61 3, respective- 
ly (step S61). Then, the video encoder 611, the audio 
encoder 612, and the sub picture encoder 613 execute 
a predetermined type of encode processing (step S62). 
[0123] TheTS object generator 610 is controlled by a 
control signal Sc6 from the system controller 520 and 
converts the data encoded in this manner to the TS ob- 
ject data constituting the transport stream (step S63). In 
this case, the data array information of each TS object 
data (e.g. a record data length and the like) and the con- 
struction information of each elementary stream (e.g. 
the ES_PID, as described later, and the like) are trans- 
mitted from the TS object generator 61 0 as information 
16 to the system controller 520 and are stored into the 



memory 530 (step S66). 

[0124] On the other hand, the TS object data gener- 
ated by the TS object generator 61 0 is transmitted to the 
© side of the switch Sw1 of the formatter 608. Namely, 

5 when formatting the TS object data from the TS object 
generator 6 1 0, the formatter 608 is switching-controlled 
by the switch control signal Sc5 from the system con- 
troller 520 to change the switch Sw1 to the© side and 
the switch Sw2 to the® side, thereby outputting the TS 

10 object data (step S64). Then, this TS object data is re- 
corded onto the optical disc 100 through the modulator 
606 (step S65). 

[01 25] Along with these operations, using the data ar- 
ray information of each TS object data and the construc- 
ts tion information of each elementary stream taken into 
the memory 530 as the information 1 6, the file system / 
logical structure data generator 521 prepares the logical 
information file data D4 (step S24 and step S25). Then, 
after completing the record of a series of the TS object 
20 data D1 , this is additionally recorded onto the optical 
disc 100 (step S67 and step S68). Incidentally, the step 
S24 and the step S25 may be processed after the step 
S65. 

[0126] Moreover, as the occasion demands (e.g. in 
25 the case of editing one portion of the title), by adding the 
user input 12 such as the title information and the like 
form the user interface 720 onto these information 
stored in the memory 530, it is possible to prepare the 
logical information file data D4 with the file system / log- 
30 ical structure generator 521 and additionally record this 
onto the optical disc 1 00. 

[01 27] As described above, the information recording 
/ reproducing apparatus 500 performs the record 
processing in the case of the recording the video data, 
35 the audio data, and the sub picture data, which are in- 
dividually prepared in advance. 

[0128] Incidentally, this record processing is applica- 
ble even when recording an arbitrary content the user 
has. 

40 

(i-4) The case of recording the data by authoring 

[0129] This case will be explained with reference to 
FIG. 9 and FIG. 13. Incidentally, in FIG. 13, the same 
45 steps as those in FIG. 1 0 have the same step reference 
numbers, and their explanation will be omitted as occa- 
sion demands. 

[01 30] In this case, by combining the above described 
three types of record processing in the three cases, an 

so authoring system generates the TS object, the logical 
information file data, and the like in advance (step S81 ), 
and then completes the processing of switching-control 
performed at the formatter 608 (step S82). Then, the in- 
formation obtained by this operation is transmitted to the 

55 modulator 606 equipped in front of and/or behind an 
original disc cutting machine, as the disc image data D5 
(step S83), and this cutting machine prepares the orig- 
inal disc (step S84). 
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(ii) Configuration and Operation in Reproduction 
System 

[0131] Next, the specific configuration and operation 
of each constitutional element constituting the reproduc- 
tion system in the information recording / reproducing 
apparatus 500 will be explained with reference to FIG. 
9 and FIG. 14. 

[0132] The user interface 720 inputs the title to be re- 
produced, its reproduction condition, and the like to the 
system controller 520 as the user input 12 of the title in- 
formation and the like. In this case, the user interface 
720 is controlled by the control signal Sc4 from the sys- 
tem controller 520, and it can perform the input process- 
ing according to the content to be reproduced, such as 
choosing through a title menu screen, 
[0133] Responding to this, the system controller 520 
controls the disc reproduction with respect to the optical 
disc 1 00, and the optical pickup 502 transmits a reading 
signal S7 to the demodulator 506. 
[0134] The demodulator 506 demodulates a recorded 
signal recorded on the optical disc 1 00 from this reading 
signal S7, and outputs it as demodulated data D8. The 
logical information file data (i.e. the file system 105, the 
disc information file 110, the P list information file 120, 
and the object information file 130, shown in FIG. 3) in- 
cluded in this demodulated data D8 as being a not-mul- 
tiplexed information part is supplied to the system con- 
troller 520. On the basis of this logical information file 
data, the system controller 520 executes various repro- 
duction control, such as processing of determining a re- 
production address and controlling the optical pickup 
502. 

[0135] On the other hand, as for the TS object data 
included in the demodulated data D8 as being a multi- 
plexed information part, the demultiplxer 508 is control- 
led by a control signal Sc2 from the system controller 
520 to demultiplex the TS object data. Here, the control 
signal Sc2 Is transmitted so as to start demultiplexing 
when completing an access to a reproduction position 
address by the reproduction control of the system con- 
troller 520. 

[01 36] The demultiplexer 508 transmits and supplies 
the video packet, the audio packet, and the sub picture 
packet, to the video decoder 511, the audio decoder 
512, and the sub picture decoder 513, respectively. 
Then, the video data DV, the audio data DA, and the sub 
picture data DS are respectively decoded. 
Incidentally, the packets included in the transport 
stream, in each of which the PAT or the PMT is pack- 
etized as shown in FIG. 6, are respectively included as 
a part of the demodulated data D8; however, they are 
discarded or abandoned at the demultiplexer 508. 
[01 37] The adder 51 4 is controlled by a control signal 
Sc3 giving an instruction of the mixing from the system 
controller 520, and mixes or superimposes in a prede- 
termined timing the video data DV and the sub picture 
data DS, which are respectively decoded at the vide de- 



coder 511 and the sub picture decoder 513. The result 
is outputted as a video output from the information re- 
cording / reproducing apparatus 500 to a TV monitor, for 
example. 

5 [01 38] On the other hand, the audio data DA decoded 
at the audio decoder51 2 is outputted as an audio output 
from the information recording / reproducing apparatus 
500 to an external speaker, for example. 
[0139] Here, the specific example of a reproduction 

10 processing routine by the system controller 520 will be 
explained with reference to FIG. 14. 
[0140] In FIG. 14, assume that as an initial condition, 
the recognition of the optical disc 1 00 in the reproduction 
system and the recognition of a volume structure and a 

15 file structure by the file system 1 05 (refer to FIG. 3) have 
been already completed by the system controller 520 
and the file system / logical structure data interpret de- 
vice 522 inside the system controller 520. Here, it will 
be explained the operational flow after obtaining the to- 

20 tal number of the total titles from the disc comprehensive 
information 1 1 2 in the disc information file 1 1 0 and then 
choosing or selecting one title from among them, 
[01 41 ] Firstly, the choice or selection of the title is per- 
formed at the user interface 720 (stepS11), and the sys- 

25 tern controller 520 obtains the information about the re- 
production sequence from a reading result of the file 
system / logical structure data interpret device 522. 
More specifically, it obtains the information indicating 
the process play list structure of the logical hierarchy 

30 and the information of Item or Items constituting the 
process play list structure (refer to FIG. 7) (step S12). 
By this, a reproduction object is determined (step S13). 
[0142] Then, the object information file 130 related to 
the TS object as being the reproduction object is ob- 

35 tained. Especially in the embodiment, the AU informa- 
tion 1321 and PU (Presentation Unit) information 3021, 
which will be described later, are also obtained as the 
information stored in the object information file 1 30 (step 
S14). These obtained information allow the association 

40 or correlation of the above described logical hierarchy 
and the object hierarchy (refer to FIG. 7). 
[0143] Then, on the basis of the information obtained 
in the step S1 4, the object to be reproduced and the re- 
production address are determined (step S1 5), and then 

45 the processing of the object hierarchy is started; namely, 
the actual reproduction is started (step S16). 
[0144] While reproducing, it is monitored whether or 
not the command-input of a "scene change" corre- 
sponding to the change of the PU 302 in the AU 132 

so based on the PU information 302I and the AU informa- 
tion 1321, as described later is performed (step S17). If 
the "scene change" is command-inputted (step S17: 
Yes), the operational flow returns to the step S15, and 
the processes from the step S15 to the step S17 are 

55 repeatedly executed. On the other hand, if the "scene 
change" is not command-inputted (step S17: No), the 
presence or the absence of the command input indica- 
tive of ending the reproduction processing is judged 
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(step S1 8). If there is not the command input indicating 
of ending (step S1 8: No), the operational flow returns to 
the step S11 , and the processes inform the step S11 to 
the step S18 are repeatedly executed. On the other 
hand, if there is the command input indicative of ending 
(step S18: Yes), a series of the reproduction processing 
ends. 

(Access Row in reproducing) 

[0145] Next, the flow of the access in reproducing at 
the information recording / reproducing apparatus 500, 
which uses the AU information 1321 and the PU infor- 
mation 3021, as one of the features of this embodiment, 
will be explained as well as the logical structure of the 
optical disc 100. FIG. 15 is a schematic diagram show- 
ing an entire flow of the access in reproducing, in relation 
to the logical structure of the optical disc 100. 
[0146] In FIG, 15, the logical structure of the optical 
disc 100 is categorized broadly into the following three 
hierarchies: a logical hierarchy 401 ; an object hierarchy 
403; and a logic-object associating hierarchy 402 mutu- 
ally associating those two hierarchies. 
[0147] Among them, the logical hierarchy 401 is a hi- 
erarchy that logically specifies various logical informa- 
tion to reproduce the desired title when reproducing, as 
well as the play list to be reproduced and its construction 
content. In the logical hierarchy 401, disc information 
110d indicating the entire titles 200 and the like on the 
optical disc 100 is written within the disc information file 
110 (refer to FIG. 3), and further, reproduction sequence 
information 120d of the entire contents on the optical 
disc 1 00 is written within the play list information file 1 20 
(refer to FIG. 3). More specifically, the construction of 
one or a plurality of play lists 126 is written in each title 
200 as the reproduction sequence information 120d, 
and the construction of one or a plurality of Items 204 is 
written in each play list 126. Then, in accessing at the 
time of the reproduction, the logical hierarchy 401 as de- 
scribed above specifies the title 200 to be reproduced, 
the play list 126 corresponding to this, and further the 
Item 204 corresponding to this. 

[0148] Then, the logic-object associating hierarchy 
402 is a hierarchy that specifies the attribute and the 
physical storing address of the TS object data 140d to 
be reproduced, so as to specify the combination and/or 
the construction of the TS object data 1 40d as being the 
entity data and perform an address conversion to the 
object hierarchy 403 from the logical hierarchy 401 , on 
the basis of the information specified in the logical hier- 
archy 401 as described above. More specifically, in the 
logic-object associating hierarchy 402, the object infor- 
mation data 130d, which separates a group of the con- 
tents constituting each Item 204 into the units of the AU 
132 and which finely separates each AU 132 into the 
units of the PU 302, is written in the object information 
file 130 (refer to FIG. 3). 

[0149] Here, "the PU (Presentation Unit) 302° is one 



example of "a sub group" in the present invention, and 
is a unit of associating and grouping a plurality of ele- 
mentary streams in the unit of changing the reproduc- 
tion. For example, as is the title #1 in the specific exam- 

5 pies shown later in FIG. 1 6 to FIG. 22, the PU 302 is a 
unit of grouping the elementary stream packet ID 
(ES_PID) and the like for each vision of a "multi-vision 
title". If there are three audio streams in this PU 302, the 
user can also freely change three audio (e.g. audio in 

10 different languages and the like) while reproducing this 
vision. 

[0150] On the other hand, "the AU (Associate Unit) 
132" is a unit of associating or grouping a plurality of 
elementary streams, such as the video stream, in the 

is TS object used in one title, and is a group of one or a 
plurality of PUs 302. More specifically, the AU 132 is a 
unit of grouping the elementary stream packet ID 
(ES_PID) for each TS object, indirectly through the PU 
302. This AU 132 corresponds to a group of a plurality 

20 of shows or programs mutually having a special rela- 
tionship considering the contents, for example, a plural- 
ity of shows or programs mutually changeable in multi- 
ple broadcasting and the like. Then, the PU 302 corre- 
sponds to a group of one or a plurality of elementary 

25 streams, which belong to the same AU 132 and which 
constitute a plurality of shows or programs mutually 
changeable by the user operation when reproducing. 
[0151] Therefore, if the AU 132 to be reproduced is 
specified, and moreover, the PU 302 is specified, then 

30 the elementary stream to be reproduced is specified. 
Namely, even if not using the PAT nor the PMT shown 
in FIG. 6, it becomes possible to reproduce the desired 
elementary stream from among the multiplexed and re- 
corded elementary streams from the optical disc 100. 

35 [0152] The more specific data structure of the AU in- 
formation 1321 and the PU information 3021, which re- 
spectively define the AU 132 and the PU 302 described 
above, will be explained later with reference to FIG. 25. 
[0153] Here, the elementary stream that is actually re- 

40 produced is identified or specified by the ES_PI D, which 
is the packet ID of the elementary stream (refer to FIG. 
6), from the PU information 302I. At the same time, by 
converting the information indicating the starting time 
and the ending time of the reproduction to the address 

45 information of the elementary stream, the content in a 
specific area (or specific time range) of a specific ele- 
mentary stream is reproduced. 

[0154] In this manner, in the logic-object associating 
hierarchy 402, the address conversion to the physical 

50 address related to each PU 302 from the logical address 
related to each Item 204 is executed. 
[0155] Then, the object hierarchy 403 is a physical hi- 
erarchy to reproduce the actual TS object data 140d. In 
the object hierarchy 403, the TS object data 1 40 d is writ- 

55 ten within the object data file 140 (refer to FIG. 3). More 
specifically, the TS packets 146 constituting a plurality 
of elementary streams (ES) are multiplexed at each time 
point, and the arrangement of theTS packets 146 along 
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the time axis enables a plurality of elementary streams 
to be constructed (refer to FIG. 5). Then, the plurality of 
TS packets 146 multiplexed at each time point are as- 
sociated with the PL) 302 identified at the logic-object 
associating hierarchy 402, for each elementary stream. 
Incidentally, it is also possible to associate a plurality of 
PUs 302 with one elementary stream (e.g. to share the 
elementary stream related to the same audio data and/ 
or the elementary stream related to the same sub picture 
data, among a plurality of changeable shows or pro- 
grams). 

[01 56] In this manner, in the object hierarchy 403, the 
actual object data is reproduced using the physical ad- 
dress obtained by the conversion at the logic-object as- 
sociating hierarchy 402. 

[0157] As described above, the three hierarchies 
shown in FIG. 15 allow the execution of the access with 
respect to the optical disc 100 in reproducing. 

(Specific Example of Data Structure Recorded on 
Optical Disc) 

[0158] Next, with reference to FIG. 1 6 to FIG. 21 , the 
data structure on the optical disc 100 on which the AU 
(Associate Unit) information and the PU (Presentation 
Unit) information, as one of the features of this embod- 
iment, are recorded will be explained, in addition to the 
PAT (Program Association Table) and the PMT (Pro- 
gram Map Table), as one of the features of the transport 
stream. 

[01 59] In this specific example, it will be explained the 
data structure constructed on the optical disc 100 in the 
case of constructing two titles within the optical disc 1 00 
with respect to the object provided with the three TS ob- 
jects #1, #2, and #3. FIG. 16 is a schematic diagram 
showing the data structures of TS objects #1 and #2 in- 
cluding a plurality of elementary streams in this specific 
example. FIG. 17 is a schematic diagram showing the 
data structures of the PAT and the PMT of the TS object 
#1 in this specific example. FIG. 18 is a schematic dia- 
gram showing the data structures of a PAT and a PMT 
of the TS object #2 in this specific. FIG . 1 9 is a schematic 
diagram showing the data structure of the TS object #3 
in this specific example. FIG. 20 is a schematic diagram 
showing the data structures of a PAT and a PMT of the 
TS object #3 in this specific example. FIG. 21 is a sche- 
matic diagram showing the data structure finally con- 
structed on the optical disc 1 00 in this specific example. 
[0160] Firstly, as shown in FIG. 16, the title #1 is con- 
structed by using the TS #1 object and the TS #2 object 
as they are, with the transport stream that is used in dig- 
ital broadcasting as those two TS objects 142 (refer to 
FIG. 3). The "show 1 " in FIG. 1 6 is the binary broadcast- 
ing which uses two programs, whose program map 
packet IDs ("Program Map PIDs") are "100" and "200" 
that have program numbers ("Program No" in FIG. 16) 
"1" and "2", respectively. On the other hand, the "show 
2" in FIG. 1 6 is normal broadcasting which uses one pro- 



gram, whose program map packet ID is "300" that has 
a program number "3". For example, the elementary 
stream (ES) corresponding to the program whose pro- 
gram number is "1 " is "Video 1 (video stream 1 )", "Audio 

5 1 (audio stream 1)", and "Audio 2 (audio stream 2)". 
Their elementary stream packet IDs (ES_PID) are 
"101", "102", and "103", respectively (refer to FIG. 6). 
The other contents of the elementary stream (ES) and 
the packet ID (ES_PID) are as shown in FIG. 16. 

10 [0161] In this specific example as shown in FIG. 17, 
the TS #1 object is constructed such that one PAT can 
specify three PMTs and that each PMT can specify each 
TS packet of the elementary stream to be reproduced, 
with respect to the PAT and the PMT at the time of broad- 

15 casting. 

[0162] More specifically, the packet ID (PID) of the 
PAT is set to a defined value such as "000", and because 
of this, it is possible to firstly specify or determine the 
PAT from among many packets (refer to FIG. 6) multi- 

20 plexed each time point. Moreover, referring to the con- 
tents of the specified PAT, it is possible to specify the 
PMTs from among many packets (refer to FIG. 6) mul- 
tiplexed each time point by use of the packet ID of the 
PMT for the " Program 1" (e.g. "100"), the packet ID of 

25 the PMT for the " Program 2" (e.g. "200"), or the packet 
ID of the PMT for the " Program 3" (e.g. "300"). 
[0163] Moreover, referring to the contents of the PMT 
as specified above can specify the TS packet whose 
content to be reproduced is packetized, from among 

30 many packets multiplexed each time point (refer to FIG. 
6). For example, in the case where the PMT for the "pro- 
gram 1" is specified, it is possible to specify the TS pack- 
et by use of the packet I D of the TS packet for the "video 
stream 1" (e.g. "101"), the packet ID of the TS packet 

35 for the "audio stream 1" (e.g. "102"), or the packet ID of 
the TS packet for the "audio stream 2" (e.g. "103' 1 ). 
Moreover, as is the case where the PMT for the "pro- 
gram 2" and the PMT for the "program 3" are specified, 
the TS packet to be reproduced can be specified, 

40 [0164] Especially, in this specific example, a group of 
data constituting a series of transport streams used for 
broadcasting (e.g. a sequentially broadcasted unit with- 
out CM (commercial) and the like) is treated as the "TS 
object" (refer to FIG. 3). Here, it is assumed that, firstly 

45 at the time of broadcasting, two shows are transmitted 
by using the TS #1 object as three programs, the "show 
2" ends as time elapses, and after a commercial, the 
"show 1" is broadcasted by using the TS #2 object. 
Therefore, its program sequence is changed in the mid- 
50 die. 

[0165] Furthermore, in this specific example as 
shown in FIG. 1 8, the TS #2 object is constructed such 
that two PMTs can be specified by one PAT and that 
each TS packet of the elementary stream to be repro- 
55 duced can be specified by each PMT, with respect to the 
PAT and the PMT at the time of broadcasting. 
[0166] As shown in FIG. 15 to FIG. 18, in this specific 
example, one title #1 is constituted by the TS #1 object 
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and the TS #2 object as they are at the time of broad- 
casting, in which the CM contents are omitted. 
[0167] Moreover, as shown in FIG, 19, the title #2 is 
constructed by using the TS #3 object in this specific 
example. The authoring operation is applied onto this 
TS object #3 so as to preliminarily store the TS object 
#3 as ROM contents. The TS object #3 is provided with 
the elementary streams for the video data and for the 
audio data, and especially, two elementary streams for 
the sub picture data (i.e. "Sub picture 1" and "Sub pic- 
ture 2" as the contents of the ES in FIG. 1 9). 
[0168] In this specific example, as shown in FIG. 20, 
the TS #3 object constituting the title 2 has the simply 
constructed PAT and PMT 

[0169] FIG. 21 shows the summary of the data struc- 
ture constructed on the optical disc 1 00, which has been 
explained with reference to FIG. 15 to FIG. 20. 
[0170] In FIG. 21 , the data structure where the two 
titles are composed of three TS objects is constructed 
on the optical disc 100. Especially, the "show 1", which 
is binary-broadcasted, is logically reconstructed on the 
optical disc 100 as the title of a "multi vision" type (i.e. 
the type with which a user can freely change to watch) 
similar to the "angle change" of the DVD. In this change, 
this title does not use the audio stream "Audio 1 " of the 
TS #1 object or the audio stream "Audio 6" of the TS #2 
object, and further it does not use the elementary stream 
of the "show 2". 

(Each Information File Structure) 

[0171] Next, with reference to FIG. 22 to FIG. 25, var- 
ious information files constructed on the optical disc 1 00 
in the embodiment, i.e. the data structures of (1 ) the disc 
information file 110, (2) the play list information file 120, 
(3) the object information file 1 30, and (4) the object data 
file 140, which have been explained with reference to 
FIG. 3, will be explained using their own specific exam- 
ples. 

(1) Disc Information File: 

[0172] Firstly, with reference to FIG. 22 and FIG. 23, 
the disc information file 110 will be explained in detail 
using one specific example. FIG. 22 is a schematic di- 
agram showing one specific example of the data struc- 
ture of the disc information file 110. FIG. 23 is a sche- 
matic diagram showing one specific example of the data 
structure of the title information table 1 1 4 included in the 
disc information file 110. 

[0173] In this specific example as shown in FIG. 22, 
the disc information file 1 1 0 stores therein the disc com- 
prehensive information 112, the title information table 
114, and the other information 118. 
[01 74] Among them, the disc comprehensive informa- 
tion 1 1 2 is comprehensive information, such as disc vol- 
ume information indicating the serial number of one se- 
ries constructed by a plurality of optical discs 100, total 



title number information and so on. 
[0175] The title information table 114 stores therein 
the entire play lists constituting each title and the other 
information, e.g. information for each title, such aschap- 

5 ter information within the title and the like, and includes 
title pointer information, title #1 information, title #2 in- 
formation, and so on. Here, the "title pointer information" 
is the storing address information of the title #n informa- 
tion, i.e. the storing address information indicating the 

10 storing position of the title #n information in the title in- 
formation table 1 1 4, as the correspondence relationship 
is indicated with arrows in FIG. 22, and the "title pointer 
information" is written with a relative logical address. 
Then, this information of the number of titles in the op- 

15 tical disc 1 00 is arranged in the order of the titles as the 
relative logical address. Incidentally, the data amount of 
each storing address information may be a fixed byte or 
a changeable byte. 

[01 76] The other information 1 1 8 is information about 
20 each title, such as the title type, for example, the se- 
quential type, the branch type, and the like, which have 
been already explained with reference to FIG. 8, and the 
total number of play lists. 

[0177] Incidentally, in the specific example shown in 
25 FIG. 16 to FIG. 21, the both titles are individually con- 
structed by simply one play list title. Therefore, in the 
case of this specific example, the title information table 
114 stored in the disc information file 110 shown in FIG. 
22 is written as a table having relatively simple contents 
30 as shown in FIG. 23. 

(2) Play List Information File: 

[0178] Next, with reference to FIG. 24, the play list in- 

35 formation file 120 will be explained in detail using one 
specific example, FIG. 24 is a schematic diagram show- 
ing one specific example of the data structure on the 
play list information table 1 21 constructed in the play list 
information file 120. 

40 [0179] In this specific example, as shown in FIG. 24, 
the play list information file 120 stores therein play list 
comprehensive information 122, a play list pointer table 
124, and a play list #1 information table and a play list 
#2 information table 126, for each Field type, as the play 

45 list information table 121 (refer to FIG. 3). 

[0180] Each Field may have a structure that allows the 
necessary number of each table to be added. For ex- 
ample, if there are four play lists, the relative Field may 
increase to four Fields underthis structure, and so does 

so the Item information table. 

[0181] Among them, the play list comprehensive in- 
formation (P list comprehensive information) 122 de- 
scribes therein the size of the play list table, the total 
number of play lists, and the like. 

55 [0182] The play list pointer table (P list pointer table) 
124 stores therein the address of each play list written 
position as being the relative logical address in the play 
list Information table 126, as the correspondence rela- 
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tionship is indicated with arrows in FIG. 24. 
[0183] The play list #1 information table (P list #1 in- 
formation table) 126 stores therein comprehensive in- 
formation about the play list #1 , the Item information ta- 
ble of the play list #1 (P list Item information table) and 
the other information. The play list #2 information table 
126 also stores therein the same type of information re- 
lated to the play list #2. 

[0184] The "Item information table" stores therein the 
Item information of the total number of Items constituting 
one program list. Here, an AU number in the AU (Asso- 
ciate Unit) table written in the "Item #1 (Item #1 informa- 
tion)" or the "Item #2 (Item #2 information)" is the 
number of the AU, which stores information for specify- 
ing the address of the TS object to be used for the Item 
reproduction, or specifying each elementary stream (i. 
e. the video stream, the audio stream, or the sub picture 
stream) in the TS object to be used for the Item repro- 
duction. 

(3) Object information file: 

[0185] Next, with reference to FIG. 25, the object in- 
formation file 130 will be explained in detail using one 
specific example. FIG. 25 is a schematic diagram show- 
ing one specific example of the data structures on the 
AU table 131 (refer to FIG. 3) constructed in the object 
information file 130 and on the ES map table 134 (refer 
to FIG. 3) related to the AU table 131 . 
[0186] In this specific example, as shown in FIG. 25, 
the object information file 130 stores therein object in- 
formation tables. The object information tables com- 
prise the AU table 131 shown in the upper part of FIG. 
25 and the ES map table 1 34 shown in the lower part. 
[0187] In the upper part of FIG. 25, the AU table 131 
may have a structure that allow the necessary number 
of tables for each Field to be added. For example, if 
there are four AUs, the relative Field may increase to 
four Fields under this structure. 

[0188] The AU table 131 stores therein "AU table 
comprehensive information" in which the number of AUs 
and the pointerto each AU, and the like are written, and 
"the other information," 

[0189] The AU table 131 describes therein the Index 
number (Index number = ...) of the corresponding ES 
map table 1 34, as the AU information 1 32I indicating an 
ES table Index #m in each PU #m corresponding to each 
AU #n. Here, the "AU" is a unit corresponding to a 
"show" in TV broadcast, for example, as mentioned 
above (especially, in the case of "multi-vision" broad- 
casting, it is a unit of a group of a plurality of "visions" 
which are changeable or selectable), and it includes one 
or more PUs, each of which is a reproduction unit. More- 
over, the "PU" is a group of mutually changeable ele- 
mentary streams which are included in each AU, as de- 
scribed above, and the ES table Index #m correspond- 
ing to each PU is specified by the PU information 302I. 
For example, in the case of constructing multi-view con- 



tents with the AU, the AU stores therein a plurality of 
PUs, and each PU stores therein the pointers to a plu- 
rality of elementary stream packet IDs, which indicate 
the packets constituting the content of each view. This 
5 indicates the Index number in the ES map table 1 34, as 
described later. 

[0190] In the lower part of FIG. 25, the ES map table 
134 stores therein ES map table comprehensive infor- 
mation, a plurality of Indexes #m (m=1, 2, ...), and the 

w " other information", for each Field. 

[0191] The "ES map table comprehensive informa- 
tion" describes therein the size of the ES map table, the 
total number of Indexes, and the like. 
[0192] The "Index #m" includes the elementary 

15 stream packet IDs (ES_PIDs) of the entire elementary 
streams to be used for the reproduction, the correspond- 
ing Index numbers, and the address information of the 
elementary stream. 

[0193] Constructed as described above, it Is possible 
20 to obtain the elementary stream packet ID (ES_PID) of 
the actual elementary stream from the Index number of 
the ES map 1 34 specified from the AU table 131. More- 
over, since the address information of the elementary 
stream corresponding to the elementary stream packet 
25 id can be obtained at the same time, it is possible to 
reproduce the object data on the basis of these informa- 
tion. 

[0194] According to the data structure of the optical 
disc 100 explained above, even in the case of adding a 

30 new title to the optical disc 100, necessary information 
can be added easily, which is useful. On the other hand, 
even if some information becomes unnecessary as a re- 
sult of editing or the like, for example, what is to be done 
is simply not to refer to the information, and it is not nec- 

35 essary to actually delete the information from the table, 
which is useful, as well. 

[0195] Incidentally, in FIG. 25, even the ES_PID that 
is not referred to from the AU table 1 31 in the upper part 
is described by the I ndex of the ES map table 1 34 in the 

40 lower part; however, it is not necessary to describe the 
ES_PIDthatis not referred to, in this manner. If the more 
versatile ES map table 1 34 is prepared in advance by 
describing the ES_PI D that is not referred to in this man- 
ner, it is not necessary to reconstruct the ES map table 

45 in the case of reediting the content, such as trying the 
authoring operation again, which is advantageous. 

(4) Object Data File: 

50 [0196] Next, the object data file 140 will be explained. 
[01 97] In this specific embodiment, the object data file 
140 stores therein three TS objects as the object data 
that are actual reproduction objects. 
[0198] The transport stream defined by the PAT and 

55 the PMT described above can be stored as they are or 
after some processes, as explained with reference to 
FIG. 9, and the information that specifies the elementary 
stream as being the reproduction object in the transport 
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stream is stored in the above described object informa- 
tion file 130 (refer to FIG. 25). The elementary stream 
is associated with the entity data in the object data file 
140 by the object information file 130. 
[0199] As explained in detail with reference to FIG. 1 5 
to FIG. 25, according to the embodiment, even if the TS 
objects 142 are prepared on the basis of different PAT 
and PMT construction rules, as is a local rule that differs 
from country to country, and even if the entity data of the 
TS objects 142 is stored on the optical disc 1 00 as it is, 
without changing the structures of the TS objects 142, 
it is possible to reproduce the information by using the 
AU information 1321 and the PU information 3021, with- 
out any problem. 

[0200] According to the embodiment, it is possible to 
logically and easily construct the title 200 by the entire 
data or the one portion of data of the TS object 1 42 (e. 
g. the "show 1 " only, or further, a certain time band where 
the "show 1 " of the TS #1 object 1 42 exists and the like 
as shown with the above described one specific exam- 
ple) or by the title 200 reproduced by connecting a plu- 
rality of TS objects 142, which is useful. In addition, by 
constructing the AU 1 32, which is a group of the relative 
elementary streams related to the above, as well as di- 
rectly pointing out the elementary stream packet ID 
(ES_PID) by each AU 132, it is possible to easily repro- 
duce the information regardless of the definition con- 
tents of the PAT and the PMT of the TS object 1 42 (i.e. 
without analyzing theTS object 142 on the basis of the 
definition rule or the interpretation rule in the information 
reproducing apparatus or a player), which is prepared 
in a different broadcast method (which is based on the 
local rules of Japan and foreign countries). In other 
words, when storing the transport stream onto the opti- 
cal disc 100, it is not necessary to reconstruct the PAT 
and the PMT As described above, even in the case of 
recording onto the same optical disc 100 a plurality of 
TS objects 142, whose PAT and PMT reconstruction 
rules are not standardized, it is possible to reproduce 
the multi-vision or multi-view show or program from the 
transport stream stored on the optical disc 100 without 
any problem (i.e. freely and appropriately according to 
a user's desire in the changeable or selectable condition 
of the vision or the view), which is extremely useful in 
practice. Therefore, it is possible to easily ensure the 
interchangeability of the reproduction with a relatively 
simple player construction. 

[0201] Moreover, according to the embodiment, by 
constructing the PU 302 structure in each AU 132, a 
group of the mutually related elementary streams (e.g. 
the video stream, the audio stream, and the like) is easily 
judged at the time of changing the reproduction scenes 
of the multi-vision title and the like, and the change func- 
tion of the audio stream in one vision and the like can 
be realized relatively simply. 

[0202] According to the embodiment, even in the case 
of adding a new elementary stream, such as the sub 
picture stream, to the already prepared TS object 142, 



it is possible to reconstruct a simple stream that only 
multiplexes the entire data, by additionally describing 
the elementary stream packet ID of the simply new ele- 
mentary stream, the PAT, the PMT, and the like, without 
changing the elementary stream packet ID (ES_PID) of 
the existing definition. As described above, the logical 
structure of the optical disc 100 in the embodiment can 
simplify the authoring operation for preparing a ROM ti- 
tle, as well as being broadly available for even a house- 
hold recorder and the like. 

[0203] In addition, according to the embodiment, 
since the AU information 1321 and the PU information 
3021 need maintenance only when editing the contents 
(i.e. it is not necessary to rewrite the PAT and the PMT), 
it is possible to edit without considering about the PAT 
or the PMT as being materials, which is extremely use- 
ful. 

[0204] Incidentally, the optical disc 1 00 as one exam- 
ple of the information recording medium and a recorder 
or a player related to the optical disc 1 00 as one example 
of the information recording / reproducing apparatus are 
explained in the above described embodiment; howev- 
er, the present invention is not limited to the optical disc, 
and the recorder or the player. The present invention is 
available for the other various information recording / 
reproducing media corresponding to the high density re- 
cording or the high transmission rate, and their record- 
ers or players. 

[0205] According to this embodiment, as described 
above in detail, it is possible to multiplex and record a 
plurality of shows or programs, which are transmitted in 
the transport stream or the like, onto the information re- 
cording medium, such as an optical disc, and relatively 
simply reproduce a desired one from among them. In 
addition, it becomes possible to easily recognize, at the 
information reproducing apparatus side, the elementary 
stream orthe like having a specific relationship, such as 
multi-vision broadcasting, multi-view broadcasting, bi- 
lingual broadcasting, and bilingual caption broadcast- 
ing. 

[0206] The present invention is not limited to the 
above-described embodiments, and changes may be 
made if desired without departing from the scope or spir- 
it of the invention which can be read from the claims and 
the entire specification. An information recording medi- 
um, an apparatus for and a method of recording the in- 
formation, an apparatus for and a method of reproduc- 
ing the information, an apparatus for and a method of 
recording and reproducing the information, a computer 
program for controlling the record or the reproduction, 
and a data structure including a control signal that ac- 
company such changes are also intended to be within 
the technical scope of the present invention. 



[0207] An information recording medium, a apparatus 
for and a method of recording the information, an appa- 
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ratus for and a method of reproducing the information, 
an apparatus for and a method of recording and repro- 
ducing the information, a computer program for control- 
ling the record or the reproduction, and a data structure 
including a control signal that are associated with the 
present invention can be applied to a high-density opti- 
cal disc for consumer or industrial use, such as a DVD, 
on which various information, such as the video infor- 
mation, the audio information, the sub picture informa- 
tion, and the reproduction control information, can be 
recorded at high density and further can be applied to a 
DVD player, a DVD recorder, and the like. Moreover, 
they can be applied to an information recording medium, 
an information recording/ reproducing apparatus, or the 
like, which are inserted in or can be connected to various 
computer equipment for consumer or industrial use, for 
example. 



Claims 

1. An information recording medium on which an en- 
tire stream including a plurality of portion streams, 
each of which comprises picture information or au- 
dio information constituting a series of content, is 
multiplexed-and-recorded by a unit of packet, which 
is a physically accessible unit, said information re- 
cording medium comprising: 

an object data file for storing object data, which 
is a logically accessible unit and is constructed 
by a plurality of packets, each of which stores 
therein a piece of the picture information or the 
audio information; 

a reproduction sequence information file for 
storing reproduction sequence information 
which defines a reproduction sequence of the 
object data stored in said object data file; and 
an object information file for storing, as repro- 
duction control information for controlling a re- 
production of said object data file, (i) corre- 
spondence definition information which defines 
a correspondence relationship between a plu- 
rality of packets, which are multiplexed on a 
time axis, and the plurality of portion streams 
and (ii) related group definition information 
which defines as a related group a group having 
a specific relation from among a plurality of se- 
ries of contents constituting the plurality of por- 
tion streams. 

2. The information recording medium according to 
claim 1 , wherein said object information file further 
stores, as the reproduction control information, sub 
group definition information which defines as a sub 
group a group of the plurality of portion streams mu- 
tually changeable by an information reproduction 
apparatus in the related group. 



3. The information recording medium according to 
claim 1 or 2, wherein the related group definition in- 
formation defines such that a same content may 
commonly belong to two or more groups, each of 

5 which is defined as the related group. 

4. The information recording medium according to 
claim 2, wherein the sub group definition informa- 
tion defines such that a same portion stream may 

10 commonly belong to two or more groups, each of 
which is defined as the sub group. 

5. The information recording medium according to 
claim 1 or 2, wherein the entire stream includes two 

is or more portion streams each constructed by main 
picture information which is the series of content as 
the picture information. 

6. The information recording medium according to 
20 claim 1 or 2, wherein the entire stream includes (i) 

the portion stream constructed by main picture in- 
formation which is the series of content as the pic- 
ture information and (ii) the portion stream con- 
structed by sub picture information which is the se- 
25 ries of content as the picture information. 

7. The information recording medium according to 
claim 1 or 2, wherein 

the entire stream comprises at least one por- 
30 tion of a transport stream of MPEG 2 and 

the related group definition information de- 
fines as the related group a group having a multi 
broadcasting relationship from among the plurality 
of series of contents. 

35 

8. The information recording medium according to 
claim 1 or 2, wherein the related group definition in- 
formation includes what defines as the related 
group the plurality of series of contents correspond- 

40 ing to one show constructed by a plurality of pro- 
grams. 

9. The information recording medium according to 
claim 1 or 2, wherein the related group definition in- 

45 formation includes what defines as the related 
group the plurality of series of contents correspond- 
ing to one show constructed by one program. 

10. An information recording apparatus for multiplexing 
50 and recording an entire stream by a unit of packet 

which is a physically accessible unit onto an infor- 
mation recording medium, said entire stream in- 
cluding a plurality of portion streams each of which 
comprises picture information or audio information 
55 constituting a series of content, said information re- 
cording apparatus comprising: 

a first recording device for recording an object 
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data file, said object data file storing object da- 
ta, which is a logically accessible unit and is 
constructed by a plurality of packets, each of 
which stores therein a piece of the picture in- 
formation or the audio information; 5 
a second recording device for recording a re- 
production sequence information file, said re- 
production sequence information file storing re- 
production sequence information which defines 
a reproduction sequence of the object data 10 
stored in said object data file; and 
a third recording device for recording an object 
information file, said object information file stor- 
ing, as reproduction control information for con- 
trolling a reproduction of said object data file, 15 
(i) correspondence definition information which 
defines a correspondence relationship be- 
tween a plurality of packets, which are multi- 
plexed on a time axis, and the plurality of por- 
tion streams and (ii) related group definition in- 20 
formation which defines as a related group a 
group having a specific relation from among a 
plurality of series of contents constituting the 
plurality of portion streams. 

25 

11. The information recording apparatus according to 
claim 10, wherein the entire stream comprises at 
least one portion of a transport stream of MPEG 2, 
which is digitally-transmitted and is received at a set 
box. 30 

12. An information recording method of multiplexing 
and recording an entire stream by a unit of packet 
which is a physically accessible unit onto an infor- 
mation recording medium, said entire stream in- 35 
eluding a plurality of portion streams each of which 
comprises picture information or audio information 
constituting a series of content, said information re- 
cording method comprising: 

40 

a first recording process of recording an object 
data file, said object data file storing object da- 
ta, which is a logically accessible unit and is 
constructed by a plurality of packets, each of 
which stores therein a piece of the picture in- *s 
formation or the audio information; 
a second recording process of recording a re- 
production sequence information file, said re- 
production sequence information file storing re- 
production sequence information which defines so 
a reproduction sequence of the object data 
stored in said object data file; and 
a third recording process of recording an object 
information file, said object information file stor- 
ing, as reproduction control information for con- 55 
trolling a reproduction of said object data file, 
(i) correspondence definition information which 
defines a correspondence relationship be- 
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tween a plurality of packets, which are multi- 
plexed on a time axis, and the plurality of por- 
tion streams and (ii) related group definition in- 
formation which defines as a related group a 
group having a specific relation from among a 
plurality of series of contents constituting the 
plurality of portion streams. 

13. The information recording method according to 
claim 12, wherein the entire stream comprises at 
least one portion of a transport stream of MPEG 2, 
which is digitally-transmitted and is received at a set 
box. 

14. An information reproducing apparatus for reproduc- 
ing one portion of the recorded entire stream from 
said information recording medium according to 
claim 1 or 2, 

said information reproducing apparatus com- 
prising: 

a reading device for physically reading the in- 
formation from the information recording medi- 
um; and 

a reproducing device for reproducing the object 
data included in the information read by said 
reading device, on the basis of the reproduction 
control information and the reproduction se- 
quence information included in the information 
read by said reading device. 

15. An information reproducing method of reproducing 
one portion of the recorded entire stream from said 
information recording medium according to claim 1 
or 2, 

said information reproducing method com- 
prising: 

a reading process of physically reading the in- 
formation from the information recording medi- 
um; and 

a reproducing process of reproducing the ob- 
ject data included in the information read by 
said reading process, on the basis of the repro- 
duction control information and the reproduc- 
tion sequence information included in the infor- 
mation read by said reading process. 

16. An information recording and reproducing appara- 
tus for recording the entire stream onto and repro- 
ducing one portion of the recorded entire stream 
from said information recording medium according 
to claim 1 or 2, 

said information recording and reproducing 
apparatus comprising: 

a first recording device for recording the object 
data file onto the information recording medl- 
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urn; 

a second recording device for recording the re- 
production sequence information file onto the 
information recording medium; 
a third recording device for recording the object s 
information file onto the information recording 
medium; 

a reading device for physically reading the in- 
formation from the information recording medi- 
um; and 

a reproducing device for reproducing the object 
data included in the information read by said 
reading device, on the basis of the reproduction 
control information and the reproduction se- 
quence information included in the information 
read by said reading device. 

17. An information recording and reproducing method 
of recording the entire stream onto and reproducing 
one portion of the recorded entire stream from said 
information recording medium according to claim 1 
or 2, 

said information recording and reproducing 
method comprising: 

a first recording process of recording the object 
data file onto the information recording medi- 
um; 

a second recording process of recording the re- 
production sequence information file onto the 
information recording medium; 
athird recording process of recording the object 
information file onto the information recording 
medium; 

a reading process of physically reading the in- 
formation from the information recording medi- 
um; and 

a reproducing process of reproducing the ob- 
ject data included in the information read by 
said reading process, on the basis of the repro- 
duction control information and the reproduc- 
tion sequence information included in the infor- 
mation read by said reading process. 

18. A computer program for controlling record which 
controls a computer provided in said information re- 
cording apparatus according to claim 10 or 11 and 
which causes the computer to function as at least 
one portion of said first recording device, said sec- 
ond recording device, and said third recording de- 
vice. 

19. A computer program for controlling reproduction 
which controls a computer provided in said informa- 
tion reproducing apparatus according to claim 14 
and which causes the computer to function as at 
least one portion of said reproducing device. 



20. A computer program for controlling record and re- 
production which controls a computer provided in 
said information recording apparatus according to 
claim 1 6 and which causes the computer to function 
as at least one portion of said first recording device, 
said second recording device, said third recording 
device, and said reproducing device. 

21 . A data structure including a control signal, in which 
an entire stream including a plurality of portion 
streams, each of which comprises picture informa- 
tion or audio information constituting a series of 
content information, is multiplexed by a unit of pack- 
et, which is a physically accessible unit, having: 

an object data file for storing object data, which 
is a logically accessible unit and is constructed 
by a plurality of packets, each of which stores 
therein a piece of the picture information or the 
audio information; 

a reproduction sequence information file for 
storing reproduction sequence information 
which defines a reproduction sequence of the 
object data stored in said object data file; and 
an object information file for storing, as repro- 
duction control information for controlling a re- 
production of said object data file, (i) corre- 
spondence definition information which defines 
a correspondence relationship between a plu- 
rality of packets, which are multiplexed on a 
time axis, and the plurality of portion streams 
and (ii) related group definition information 
which defines as a related group a group having 
a specific relation from among a plurality of se- 
ries of contents constituting the plurality of por- 
tion streams. 



15 



20 



25 



30 



35 



40 



45 



50 



24 



EP 1 469 677 A1 




25 



EP 1 469 677 A1 



FIG. 2(a) 



PROGRAM 
STREAM 



tx 

I 



-> t 



VIDEO 
STREAM 

AUDIO 
STREAM 

SUB 
PICTURE 
STREAM 



FIG. 2(b) 



tx 

I 



-> t 




TS 

(TRANSPORT/ 
STREAM) ^ 



ES 
(VIDEO 
STREAM) 



ES 
(AUDIO 
STREAM) 



ES 
(SUB 
► PICTURE 
STREAM) 



26 



EP 1 469 677 A1 




27 



EP 1 469 677 A1 



CM 



a 



o 

LU 
CO 

o 






LU 








LU 










ZD 


o 




O 


& 




to 






LU 






O 






or 












o 






CO 





00 
00 
00 




28 



EP 1 469 677 A1 




29 



EP 1 469 677 A1 



FIG. 6 
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FIG. 12 
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FIG. 13 
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FIG. 14 
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FIG. 16 
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